-- Logs begin at Fri 2022-05-13 13:04:03 UTC, end at Fri 2022-05-13 14:14:54 UTC. -- May 13 13:40:14.647470 dv-cinder-795785-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:40:14.658751 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:40:14 2022] *** May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: nodename: dv-cinder-795785-8-iscsi May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: machine: x86_64 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: clock source: unix May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: pcre jit disabled May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: detected number of CPU cores: 4 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: current working directory: / May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: detected binary path: /usr/bin/uwsgi-core May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: your processes number limit is 47680 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: your memory page size is 4096 bytes May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: detected max file descriptor number: 2048 May 13 13:40:14.660715 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: lock engine: pthread robust mutexes May 13 13:40:14.661630 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: thunder lock: enabled May 13 13:40:14.661630 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:40:14.661630 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:40:14.706636 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: Python main interpreter initialized at 0x55811562b9c0 May 13 13:40:14.706636 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: python threads support enabled May 13 13:40:14.706636 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: your server socket listen backlog is limited to 100 connections May 13 13:40:14.706636 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: your mercy for graceful operations on workers is 90 seconds May 13 13:40:14.706992 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:40:14.707055 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: *** Operational MODE: preforking *** May 13 13:40:14.707303 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: *** uWSGI is running in multiple interpreter mode *** May 13 13:40:14.707303 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: spawned uWSGI master process (pid: 109605) May 13 13:40:14.707509 dv-cinder-795785-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:40:14.708050 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 1 (pid: 109606, cores: 1) May 13 13:40:14.708394 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 2 (pid: 109607, cores: 1) May 13 13:40:14.708568 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:40:15.894887 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:40:15.913400 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:40:16.626054 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:40:16.626054 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes May 13 13:40:16.626379 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:40:16.626379 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes May 13 13:40:16.627797 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:40:16.627797 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes May 13 13:40:16.628099 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:40:16.628099 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes May 13 13:40:19.231204 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:40:19.232026 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:40:19.232581 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:40:19.232878 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:40:19.233300 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:40:19.233395 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:40:19.233474 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:40:19.233549 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.233620 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:40:19.233877 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.234020 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:40:19.234228 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.234380 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:40:19.234557 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.234718 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.234893 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235036 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235202 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235352 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235487 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235732 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.235876 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236048 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236139 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236352 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236461 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236682 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236780 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.236995 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237085 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-8-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237317 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237419 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237570 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237664 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237882 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.237979 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238233 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-8-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238332 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238548 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238646 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238871 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.238970 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.239179 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.239272 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.239539 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.239655 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.239829 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.240859 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.240965 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241043 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241117 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241184 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241254 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241344 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241412 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241483 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241555 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241627 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241812 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.241941 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242154 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242285 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242469 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242604 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242778 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.242904 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243090 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243283 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-8-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243418 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243604 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243731 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.243918 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244050 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244233 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244364 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-8-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244649 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244783 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.244966 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245104 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245314 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245452 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245580 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245715 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.245873 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246000 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246219 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246345 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246544 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246697 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.246913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247465 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247579 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247677 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247789 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247861 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.247943 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248022 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248214 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248379 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248525 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248665 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248806 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.248947 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249079 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249209 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249355 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249511 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249704 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.249851 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250014 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250141 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250381 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250484 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250683 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250785 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.250981 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251080 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251263 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251352 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251514 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251605 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251832 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.251936 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252143 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252233 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252457 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252555 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252768 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.252863 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253058 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253154 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253363 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253469 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253667 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253759 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.253970 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254076 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254299 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254430 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254601 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.254927 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255109 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255246 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255419 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255567 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255724 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.255874 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256039 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256193 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256353 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256590 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256724 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.256852 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257040 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257154 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257362 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257469 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257755 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.257859 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258003 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258147 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258353 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258453 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258692 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258794 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.258997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259093 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259303 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259389 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259606 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259692 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.259921 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260019 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260246 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260330 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260549 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260642 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260798 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.260897 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261100 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261185 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261402 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261667 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261768 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.261973 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.262092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.262247 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.262351 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.262774 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263231 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263318 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263398 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263498 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263579 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263779 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.263881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264085 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264179 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264389 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264485 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264696 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.264793 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265000 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265092 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265305 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265390 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265611 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265709 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.265915 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266007 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266258 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266351 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266580 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266730 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266885 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.266985 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267188 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267273 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267491 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267584 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267794 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.267936 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268108 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268196 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268409 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268494 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268713 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.268807 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269035 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269129 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269339 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269436 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269643 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269728 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.269952 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270056 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270279 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270378 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270582 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270667 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270904 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.270996 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271204 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271291 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271518 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271642 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271835 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.271964 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.272144 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.272309 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.272439 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.272708 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.272794 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.273021 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.273107 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.273322 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.273406 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.273971 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274127 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274299 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274395 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274600 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274695 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274897 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.274981 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275215 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275308 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275514 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275604 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275814 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.275907 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276116 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276203 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276415 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276506 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276711 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.276796 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.277056 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.277149 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.277371 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.277463 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.277673 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.277766 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.277974 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.278125 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.278371 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.278476 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.278707 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:40:19.278821 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279018 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279112 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279330 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279415 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279644 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279748 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.279972 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280058 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280289 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280380 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280602 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280688 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280913 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.280998 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281219 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281303 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281531 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281618 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281854 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.281939 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282186 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282276 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282496 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282608 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282805 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.282892 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283114 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283199 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283427 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283522 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283752 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.283837 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284061 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284146 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284372 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284457 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284684 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284769 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.284997 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285089 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285339 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285425 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285663 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285748 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.285985 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286101 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286323 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286410 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286639 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286725 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.286951 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287044 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287276 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287374 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287596 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287692 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.287906 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288004 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288212 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288292 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288522 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288607 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288824 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.288917 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289135 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289218 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289447 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289540 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289756 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.289842 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290091 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290181 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290403 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290489 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290710 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.290805 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291017 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291102 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291325 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291410 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291632 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291719 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.291946 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292046 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292258 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292347 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292563 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292649 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292867 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.292951 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.293170 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.293254 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.293478 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.293565 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.294177 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.294283 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.294529 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.294836 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.294924 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295136 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295221 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295442 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295527 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295747 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.295835 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296066 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296152 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296392 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296485 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296696 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.296783 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297023 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297117 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297326 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297422 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297634 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297722 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.297945 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298031 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298278 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298429 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298583 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298670 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298894 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.298981 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299300 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299508 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299595 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299830 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.299921 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300139 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300233 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300448 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300541 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300769 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.300898 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301082 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301177 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301394 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301480 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301704 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.301788 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302013 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302175 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302346 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302433 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302655 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302740 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.302962 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303055 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303281 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303372 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303702 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.303919 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304005 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304240 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304331 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304568 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304653 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304883 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.304975 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305189 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305272 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305515 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305609 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305822 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.305907 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306148 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306237 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306457 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306555 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306759 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.306847 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307061 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307158 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307362 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307458 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307663 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307747 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.307962 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308261 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308357 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308562 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308648 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308861 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.308946 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.309161 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.309247 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.309541 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.309968 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310057 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310141 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310141 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310312 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310432 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310518 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310740 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.310827 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311080 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311174 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311382 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311466 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311709 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.311800 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312024 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312111 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312343 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312428 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312662 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312755 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.312968 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313052 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313280 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313363 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313585 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313677 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313893 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.313984 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314226 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314324 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314533 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314637 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314849 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.314941 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315173 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315257 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315488 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315581 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315792 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.315883 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316101 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316198 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316419 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316506 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316739 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.316826 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317040 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317126 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317352 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317438 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317684 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317811 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.317993 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318098 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318333 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318420 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318643 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318736 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.318946 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319031 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319257 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319351 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319562 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319646 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319867 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.319952 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320173 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320260 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320480 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320574 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320789 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.320881 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321091 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321188 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321402 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321488 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321706 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.321799 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322010 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322132 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322337 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322423 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322649 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322743 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.322947 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323033 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323254 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323339 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323580 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323744 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.323998 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324217 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324301 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324528 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324613 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.324986 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325224 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325317 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325533 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325628 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325844 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.325997 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.326205 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.326340 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.326521 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.326721 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.326836 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327042 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327165 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327403 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327504 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327741 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.327825 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328046 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328133 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328349 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328436 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328657 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328742 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.328978 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329069 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329289 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329385 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329592 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329686 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329899 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.329985 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330228 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330317 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330534 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330620 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330859 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.330961 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331169 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331255 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331478 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331563 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331782 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.331899 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332084 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332223 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332431 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332524 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332742 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.332839 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333134 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333365 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333457 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333685 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333778 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.333996 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334099 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334322 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334410 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334631 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334728 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.334942 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335028 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335259 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335353 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335573 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335671 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335882 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.335999 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.336193 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.336329 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.336511 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.336673 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.336812 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337033 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337120 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337342 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337438 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337653 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337749 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.337962 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338096 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338295 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338395 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338690 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.338920 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339012 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339223 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339316 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339528 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339812 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.339898 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340120 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340213 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340422 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340518 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340781 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.340970 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341326 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341418 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341499 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341654 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341743 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.341969 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342077 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342320 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342408 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342636 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342735 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.342951 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343046 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343284 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343377 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343590 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343684 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343908 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.343993 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344213 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344309 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344522 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344615 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344825 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.344908 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345127 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345211 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345426 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345524 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345726 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.345811 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346027 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346153 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346352 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346439 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346659 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346753 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.346960 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347053 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347259 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347343 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347558 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347644 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.347857 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348022 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348156 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348238 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348458 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348553 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348763 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.348894 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349058 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349155 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349375 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349470 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349679 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349774 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.349979 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350095 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350306 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350395 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350607 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350694 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.350945 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351031 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351252 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351335 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351576 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351663 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351880 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.351974 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352188 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352274 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352490 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352577 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352801 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.352886 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353116 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353256 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353415 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353509 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353720 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.353806 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354018 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354164 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354349 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354443 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354652 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354737 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.354953 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355057 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355267 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355353 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355571 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355657 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355875 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.355971 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.356231 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.356465 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.356885 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.356984 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357076 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357158 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357236 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357344 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357431 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357659 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357761 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.357970 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.358080 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.358308 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.358435 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.358740 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.358858 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359075 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359170 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359386 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359474 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359691 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359786 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.359994 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360090 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360305 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360390 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360607 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360694 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.360999 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361210 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361296 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361516 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361603 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361823 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.361910 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362146 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362237 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362458 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362545 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362764 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.362850 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363064 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363156 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363363 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363449 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363668 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363753 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.363968 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364062 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364268 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364354 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364577 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364669 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.364976 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365187 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365280 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365495 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365580 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365801 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.365895 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366126 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366213 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366432 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366517 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366733 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.366880 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367034 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367122 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367335 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367453 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367657 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367795 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.367966 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368099 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368269 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368403 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368577 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368723 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.368879 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369063 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369220 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369468 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369565 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369811 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.369901 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370138 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370247 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370442 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370544 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370800 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.370887 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.371115 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.371201 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.371429 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.371604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.371764 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372098 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372461 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372461 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372634 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372715 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.372794 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373000 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373094 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373306 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373451 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373612 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373724 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.373934 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374019 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374273 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374378 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374588 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.374908 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375092 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375233 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375398 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375557 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375703 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.375863 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376023 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376174 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376343 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376489 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376649 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376820 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.376966 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377127 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377288 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377439 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377608 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377754 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.377996 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.378116 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.378377 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.378463 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.378687 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.378779 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379001 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379100 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379309 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379399 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379612 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379703 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.379921 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380015 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380226 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380311 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380582 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380676 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380890 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.380999 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.381228 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.381354 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.381640 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.381725 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.381950 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382088 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382289 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382375 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382594 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382679 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.382918 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383004 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383226 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383320 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383529 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383624 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383837 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.383922 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384139 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384227 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384517 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384614 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384833 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.384918 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385147 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385255 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385454 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385602 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385872 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.385965 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386210 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386359 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386524 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386678 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386837 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.386990 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.387143 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.387306 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.387492 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.387722 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.387892 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388241 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388324 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388413 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388507 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388674 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.388761 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389006 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389329 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389425 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389637 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389722 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.389959 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.390073 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.390371 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.390470 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.390697 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.390784 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391001 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391085 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391370 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391456 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391692 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.391828 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392018 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392104 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392344 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392430 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392663 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392747 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.392986 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393070 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393294 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393427 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393609 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393768 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.393920 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394240 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394347 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394576 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394664 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394896 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.394990 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395215 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395301 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395521 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395617 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395844 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.395930 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396166 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396261 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396481 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396568 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396804 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.396898 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397133 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397226 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397458 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397552 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397770 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.397863 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.398107 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.398208 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.398414 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.398844 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399108 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399194 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399412 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399496 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399727 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.399814 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400034 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400119 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400340 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400471 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400665 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400791 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.400975 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401097 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401289 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401416 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401609 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401745 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.401923 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402071 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402252 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402380 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402558 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402691 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.402995 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.403341 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.403822 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.403915 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.403995 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404075 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404152 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404346 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404435 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404658 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404744 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.404975 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405061 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405282 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405370 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405583 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405677 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405890 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.405975 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406217 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406305 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406521 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406608 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406834 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.406919 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407156 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407243 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407474 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407560 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407777 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.407873 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408094 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408181 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408403 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408489 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408705 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.408801 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409004 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409090 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409305 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409391 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409641 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409741 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.409943 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410029 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410282 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410371 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410588 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410684 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410900 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.410986 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411205 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411291 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411514 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411609 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411819 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.411912 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412126 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412218 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412429 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412517 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412734 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.412827 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413034 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413118 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413333 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413421 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413638 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.413950 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414058 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414284 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414371 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414585 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414671 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414888 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.414983 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415183 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415268 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415483 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415568 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415783 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.415882 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416101 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416187 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416400 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416485 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416714 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.416809 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417019 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417114 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417318 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417405 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417620 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417758 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.417918 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418012 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418277 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418363 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418577 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418718 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.418936 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419334 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419428 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419510 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419679 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419773 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.419996 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420082 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420305 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420391 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420623 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420710 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.420933 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421027 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421246 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421333 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421559 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421774 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.421861 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422127 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422261 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422444 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422582 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422759 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.422893 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423073 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423199 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423386 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423511 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423698 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.423824 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424011 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424137 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424322 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424632 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424724 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.424944 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425032 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425271 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425436 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425580 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425665 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425890 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.425978 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426229 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426320 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426539 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426625 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426847 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.426942 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427154 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427304 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427459 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427545 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427763 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.427867 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428087 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428180 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428405 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428491 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428728 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.428821 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429045 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429135 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429359 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429450 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429669 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429763 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.429979 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430085 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430315 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430403 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430627 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430713 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.430937 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431022 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431245 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431338 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431551 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431637 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431861 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.431953 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432170 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432371 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432484 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432570 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432790 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.432877 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433101 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433196 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433414 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433501 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433718 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.433809 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.434024 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.434304 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.434549 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.434965 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435059 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435141 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435231 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435417 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435512 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435743 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.435831 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436068 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436164 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436382 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436470 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436696 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.436791 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437025 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437210 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437329 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437520 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437639 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437847 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.437935 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438190 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438282 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438513 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438601 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438827 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.438922 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439141 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439227 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439458 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439543 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439761 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.439857 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440125 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440293 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440466 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440650 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440815 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.440973 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441161 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441302 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441533 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441618 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.441953 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442259 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442407 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442587 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442674 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442896 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.442991 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.443204 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.443520 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.443606 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.443834 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.443933 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.444138 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.444260 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.444440 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.444662 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.444756 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445014 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445097 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445336 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445428 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445647 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445740 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.445950 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446125 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446298 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446474 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446604 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446851 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.446939 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447199 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447283 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447510 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447595 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447813 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.447900 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448116 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448203 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448418 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448532 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448718 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.448896 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449027 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449227 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449313 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449541 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449636 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449846 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.449973 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.450264 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.450692 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.450692 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.450870 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.450952 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451113 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451284 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451465 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451613 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451781 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.451921 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452113 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452224 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452469 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452565 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452842 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.452935 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453161 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453249 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453472 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453576 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453783 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.453869 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.454156 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.454299 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.454475 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.454564 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.454943 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455028 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455271 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455357 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455583 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455671 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.455942 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456040 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456274 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456360 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456580 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456679 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456886 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.456972 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457189 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457283 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457514 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457601 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457825 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.457950 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.458164 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.458316 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.458477 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.458650 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.458788 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459057 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459143 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459385 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459473 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459692 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.459933 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460075 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460299 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460394 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460608 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460695 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.460919 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461012 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461226 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461341 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461543 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461682 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461884 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.461992 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462225 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462321 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462545 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462631 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462860 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.462947 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463175 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463271 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463483 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463569 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463792 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.463879 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464099 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464186 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464408 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464495 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464720 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.464814 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.465046 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.465141 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.465360 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.465448 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.465712 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466288 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466384 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466454 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466533 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466687 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.466774 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467004 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467106 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467345 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467430 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467663 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467758 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.467989 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468074 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468300 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468385 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468624 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468718 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.468938 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469024 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469273 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469369 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469620 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469719 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.469935 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470020 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470282 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470380 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470589 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470676 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470895 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.470980 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.471210 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.471299 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.471527 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.471743 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.471834 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472055 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472141 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472393 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472488 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472717 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.472801 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473027 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473114 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473333 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473450 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473635 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473792 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.473940 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474163 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474266 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474540 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474633 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474847 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.474932 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475155 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475249 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475457 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475544 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475763 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.475887 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476177 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476288 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476372 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476481 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476649 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476788 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.476951 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477094 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477253 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477406 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477555 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477727 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.477859 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478056 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478183 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478396 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478494 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478736 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.478837 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479049 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479135 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479356 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479442 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479662 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479749 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.479966 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480052 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480268 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480403 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480578 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480666 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480878 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.480964 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.481203 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.481817 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.481930 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482015 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482190 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482277 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482277 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482422 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482510 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482785 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.482905 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483097 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483217 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483408 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483524 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483719 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.483827 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484045 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484140 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484372 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484457 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484677 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484774 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.484999 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485096 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485315 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485451 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485781 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.485951 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486189 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486278 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486514 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486602 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486823 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.486919 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487143 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487249 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487491 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487576 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487799 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.487900 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488109 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488195 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488424 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488510 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488738 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.488837 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489060 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489147 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489374 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489460 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489680 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489767 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.489987 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490119 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490339 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490424 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490685 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490771 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.490995 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491098 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491338 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491432 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491659 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491745 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.491969 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492053 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492280 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492365 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492586 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492674 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.492830 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:40:19.492924 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.493207 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.493517 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.493827 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.494165 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.494482 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.494791 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.495105 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.495421 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.495746 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.496067 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.496376 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.496697 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.497106 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.497448 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.497760 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.498125 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.498453 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.498765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.499074 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.499377 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:40:19.499616 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:40:19.517412 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.523916 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.579931 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.context [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bbb2759-67a0-478c-9905-0185ee945b1d(cell1) {{(pid=109606) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:40:19.584251 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:40:19.585849 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:40:19.586657 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:40:19.586813 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.context [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bbb2759-67a0-478c-9905-0185ee945b1d(cell1) {{(pid=109607) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:40:19.588589 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:40:19.591163 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:40:19.592775 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:40:19.593551 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:40:19.595539 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:40:19.599613 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.602523 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.610368 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.613463 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.772160 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:19.775931 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:40:20.117691 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:40:20.124314 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:40:20.125123 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:40:20.131722 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:40:20.469927 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:40:20.476155 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:40:20.482399 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55811562b9c0 pid: 109606 (default app) May 13 13:40:20.484488 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:40:20.485707 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001794 May 13 13:40:20.486413 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Fri May 13 13:40:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:40:20.488745 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:40:20.494951 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-f1d4b9eb-8087-4c03-b6f4-cb8bac30b395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:40:20.501896 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55811562b9c0 pid: 109607 (default app) May 13 13:41:38.818791 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:38.819795 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 13 13:41:38.820148 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:39.247596 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-7095478f-23e9-4b6a-9a97-f7f1bc2f256a admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:39.279342 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-7095478f-23e9-4b6a-9a97-f7f1bc2f256a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452058 May 13 13:41:39.280855 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 13 13:41:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:41.572054 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:41.573060 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c342aa71-a2ab-4d2e-b628-de2f8726dd14 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 13 13:41:41.573461 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:41.638515 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-76388a83-42a1-4d86-b263-33bdec90041f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "c1", "ram": 256, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:41.657211 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:41:41.657211 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: warnings.warn(msg) May 13 13:41:41.686943 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-76388a83-42a1-4d86-b263-33bdec90041f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107459 May 13 13:41:41.687589 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:41:41.903923 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2a67ff2d-7e04-4f45-9d12-c05cca0d4896 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:41.906421 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:41:41.906421 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:41:41.956011 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2a67ff2d-7e04-4f45-9d12-c05cca0d4896 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.259224 May 13 13:41:41.970077 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 13 13:41:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:44.267681 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-76388a83-42a1-4d86-b263-33bdec90041f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:44.268729 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-76388a83-42a1-4d86-b263-33bdec90041f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 13 13:41:44.269219 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:44.376998 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-7fac378c-270c-4c74-b78e-332b5b29fd95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:44.394486 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:41:44.394486 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:41:44.413416 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-7fac378c-270c-4c74-b78e-332b5b29fd95 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137849 May 13 13:41:44.414145 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:41:44.426539 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-6cd32d16-1641-4748-9b8b-1fd201741aa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:44.428067 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:41:44.428067 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: warnings.warn(msg) May 13 13:41:44.467557 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-6cd32d16-1641-4748-9b8b-1fd201741aa3 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044991 May 13 13:41:44.468195 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 13 13:41:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:41:46.737475 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-7fac378c-270c-4c74-b78e-332b5b29fd95 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:46.738529 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-7fac378c-270c-4c74-b78e-332b5b29fd95 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 13 13:41:46.739180 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:46.801559 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a048963d-c5f0-4bb0-8d35-992a841f762d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:46.820885 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a048963d-c5f0-4bb0-8d35-992a841f762d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075167 May 13 13:41:46.821623 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:41:46.833031 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-703ff8d6-8264-4d03-9de5-43394752925e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:46.856145 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-703ff8d6-8264-4d03-9de5-43394752925e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026724 May 13 13:41:46.857162 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 13 13:41:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:49.094489 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a048963d-c5f0-4bb0-8d35-992a841f762d admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:49.095656 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a048963d-c5f0-4bb0-8d35-992a841f762d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 May 13 13:41:49.096347 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:49.157722 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-aa7edf05-6c84-47b7-99fa-64b476d1653a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:49.176008 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-aa7edf05-6c84-47b7-99fa-64b476d1653a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073276 May 13 13:41:49.176876 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:41:49.188642 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-ad1a549b-76bb-4a43-9afd-9f1790a8892b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:49.211599 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-ad1a549b-76bb-4a43-9afd-9f1790a8892b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026677 May 13 13:41:49.212209 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 13 13:41:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:51.487480 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-aa7edf05-6c84-47b7-99fa-64b476d1653a admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:51.489250 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-aa7edf05-6c84-47b7-99fa-64b476d1653a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 May 13 13:41:51.489698 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:51.551220 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:51.570498 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074853 May 13 13:41:51.578016 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:41:51.582996 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-baf7eaa5-10a7-42c4-89eb-c5b0249923c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:51.607119 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-baf7eaa5-10a7-42c4-89eb-c5b0249923c4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027782 May 13 13:41:51.607819 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Fri May 13 13:41:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:53.849357 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:53.850401 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 13 13:41:53.850771 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:53.915814 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-054e15fb-adcc-4a40-9acd-c374288a3849 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:53.941587 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-054e15fb-adcc-4a40-9acd-c374288a3849 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083830 May 13 13:41:53.942184 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 13 13:41:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:41:56.222616 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:56.223994 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-2550e2c2-6a2e-46c9-a373-806f9fcaa42d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 May 13 13:41:56.224664 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:56.287706 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-6bab302a-9999-4dfa-9295-b2c6f11d5be2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "ram": 512, "swap": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:56.306435 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-6bab302a-9999-4dfa-9295-b2c6f11d5be2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075793 May 13 13:41:56.307033 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:41:56.321014 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-2aca010b-e742-439f-912f-71d0443aeae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:56.347946 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-2aca010b-e742-439f-912f-71d0443aeae4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032339 May 13 13:41:56.348766 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 13 13:41:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:41:59.008233 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-6bab302a-9999-4dfa-9295-b2c6f11d5be2 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:41:59.009171 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-6bab302a-9999-4dfa-9295-b2c6f11d5be2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 13 13:41:59.009576 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:41:59.078919 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-f8736736-5255-4868-9d24-40c565188b91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "id": "2"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:59.099587 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-f8736736-5255-4868-9d24-40c565188b91 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082689 May 13 13:41:59.100346 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:41:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:41:59.115174 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-cddd0bc9-5323-44c1-9dc2-2a92bf98d19e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:41:59.142116 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-cddd0bc9-5323-44c1-9dc2-2a92bf98d19e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031555 May 13 13:41:59.142829 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 13 13:41:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:42:01.644990 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-f8736736-5255-4868-9d24-40c565188b91 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:01.646004 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-f8736736-5255-4868-9d24-40c565188b91 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 13 13:42:01.646453 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:01.707260 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3613125b-b4d3-4c76-bec1-c70d995240ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "name": "m1.medium", "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:01.726546 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3613125b-b4d3-4c76-bec1-c70d995240ed admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073885 May 13 13:42:01.727115 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:42:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:01.739243 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-581464e7-5d1b-434e-beed-c5a312c41a67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:01.762259 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-581464e7-5d1b-434e-beed-c5a312c41a67 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026652 May 13 13:42:01.762842 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 13 13:42:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:42:03.986483 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3613125b-b4d3-4c76-bec1-c70d995240ed admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:03.987510 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3613125b-b4d3-4c76-bec1-c70d995240ed admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 13 13:42:03.987913 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:04.051734 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-16ec8645-3266-427f-a761-b55af4d6e7e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:04.070538 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-16ec8645-3266-427f-a761-b55af4d6e7e3 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076314 May 13 13:42:04.071194 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:42:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:04.083034 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-b99a97b3-27cb-4f09-8a04-b8d48c8d0a50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:04.106307 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-b99a97b3-27cb-4f09-8a04-b8d48c8d0a50 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026987 May 13 13:42:04.106869 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 13 13:42:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:42:06.519727 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-16ec8645-3266-427f-a761-b55af4d6e7e3 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:06.521566 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-16ec8645-3266-427f-a761-b55af4d6e7e3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002732 May 13 13:42:06.522522 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:06.589783 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:06.610489 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081737 May 13 13:42:06.611146 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Fri May 13 13:42:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:06.623033 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-f427475d-4898-440e-8209-57b2e4f8a6a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:06.652488 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-f427475d-4898-440e-8209-57b2e4f8a6a6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032873 May 13 13:42:06.653448 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Fri May 13 13:42:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:42:30.668653 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:30.670355 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 May 13 13:42:30.670961 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:30.732905 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-4a683de5-913a-49df-90a0-d09b68cc2c01 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:30.751238 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-4a683de5-913a-49df-90a0-d09b68cc2c01 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073812 May 13 13:42:30.751780 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 13 13:42:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:31.770093 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:31.771093 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-05e72d9b-3f68-4494-937c-d7998f29c339 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 13 13:42:31.771518 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:31.996931 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a9ef85b1-ad92-4998-a15e-67bc83f5ea31 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:32.006084 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-a9ef85b1-ad92-4998-a15e-67bc83f5ea31 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a9ef85b1-ad92-4998-a15e-67bc83f5ea31 admin admin] Request method failure captured: May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept: application/json May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Host: 10.222.0.24 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABifmBHP8IX6capzwmNt2iMrK-r3-ezEN0zGl01rWqIfsl57n8fwTb4VnrckMQDpPRtJK8ZkSAgYPln6P30ZduWO24FLHK1OXrT9ZYosCw84zCxooX1zb79lwwwAvwSh7PM9C3uXs-mp1qMUnIAC5dXd7YD5K6CalHvWxZnTQuYUcanA98 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Role: member,admin,reader May 13 13:42:32.011205 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Roles: member,admin,reader May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User: admin May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: method: > May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: exception: Flavor 42 could not be found. May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: action_args: {'id': '42'} May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:32.012853 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:32.013913 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:32.015591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a9ef85b1-ad92-4998-a15e-67bc83f5ea31 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:32.016940 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a9ef85b1-ad92-4998-a15e-67bc83f5ea31 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076257 May 13 13:42:32.016940 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 13 13:42:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:32.025724 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-39373f40-51df-4524-b09a-640ebad57812 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:32.054666 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-39373f40-51df-4524-b09a-640ebad57812 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035290 May 13 13:42:32.055220 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:32.065559 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-e6617a26-7715-4fe3-9721-fe1abe12654a admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:32.087051 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-e6617a26-7715-4fe3-9721-fe1abe12654a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025135 May 13 13:42:32.087591 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:32.103753 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1191cf7c-6c8a-47f7-b4ac-ac0db0bb4009 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:32.110325 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-1191cf7c-6c8a-47f7-b4ac-ac0db0bb4009 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1191cf7c-6c8a-47f7-b4ac-ac0db0bb4009 admin admin] Request method failure captured: May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept: application/json May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Host: 10.222.0.24 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABifmBHP8IX6capzwmNt2iMrK-r3-ezEN0zGl01rWqIfsl57n8fwTb4VnrckMQDpPRtJK8ZkSAgYPln6P30ZduWO24FLHK1OXrT9ZYosCw84zCxooX1zb79lwwwAvwSh7PM9C3uXs-mp1qMUnIAC5dXd7YD5K6CalHvWxZnTQuYUcanA98 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Role: member,admin,reader May 13 13:42:32.113634 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Roles: member,admin,reader May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User: admin May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: method: > May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: exception: Flavor 42 could not be found. May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: action_args: {'id': '42'} May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:32.115092 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:32.115905 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:32.116997 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1191cf7c-6c8a-47f7-b4ac-ac0db0bb4009 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:32.118003 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-1191cf7c-6c8a-47f7-b4ac-ac0db0bb4009 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017983 May 13 13:42:32.118003 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 13 13:42:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:33.012191 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-e6617a26-7715-4fe3-9721-fe1abe12654a admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:33.013202 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-e6617a26-7715-4fe3-9721-fe1abe12654a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 13 13:42:33.013561 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:33.216514 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ecd114da-4438-4450-9c19-846f253b5f2c admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:33.222176 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-ecd114da-4438-4450-9c19-846f253b5f2c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ecd114da-4438-4450-9c19-846f253b5f2c admin admin] Request method failure captured: May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept: application/json May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Host: 10.222.0.24 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABifmBIFgGxy9C5RXmLONYejgjA7475QR_3G2iRU7KECLKmuizdMJH0HF0n9rNqEI3r7Aqgvs0ElJVA4hvgpaGAuEJMafsqCYPSDQ4dYq6FkRUUOMoagnI3RJQnLuK5WoH58ppGlC8abpKGN3RO02D5SPtwQkxZ7qm8DkRwNECieVh6few May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Role: member,admin,reader May 13 13:42:33.223723 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Roles: member,admin,reader May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User: admin May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: method: > May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: exception: Flavor 84 could not be found. May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: action_args: {'id': '84'} May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:33.225048 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:33.225815 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:33.227129 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ecd114da-4438-4450-9c19-846f253b5f2c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:33.228292 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ecd114da-4438-4450-9c19-846f253b5f2c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.077931 May 13 13:42:33.228292 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 13 13:42:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:33.235937 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-88ea0727-9463-4d7c-bbd8-6fe37961c726 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:33.250778 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-88ea0727-9463-4d7c-bbd8-6fe37961c726 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018432 May 13 13:42:33.251244 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:33.262925 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-9cfa14dc-615a-4de3-beda-923ca8f35fa2 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:33.281801 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-9cfa14dc-615a-4de3-beda-923ca8f35fa2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024475 May 13 13:42:33.282373 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:33.291778 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-107a4443-c7d8-4bc2-9eea-44e7f086dd26 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:33.297455 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-107a4443-c7d8-4bc2-9eea-44e7f086dd26 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-107a4443-c7d8-4bc2-9eea-44e7f086dd26 admin admin] Request method failure captured: May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept: application/json May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Host: 10.222.0.24 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABifmBIFgGxy9C5RXmLONYejgjA7475QR_3G2iRU7KECLKmuizdMJH0HF0n9rNqEI3r7Aqgvs0ElJVA4hvgpaGAuEJMafsqCYPSDQ4dYq6FkRUUOMoagnI3RJQnLuK5WoH58ppGlC8abpKGN3RO02D5SPtwQkxZ7qm8DkRwNECieVh6few May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Role: member,admin,reader May 13 13:42:33.299008 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Roles: member,admin,reader May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User: admin May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: method: > May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: exception: Flavor 84 could not be found. May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: action_args: {'id': '84'} May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:33.300492 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:33.301411 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:33.302604 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-107a4443-c7d8-4bc2-9eea-44e7f086dd26 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:33.303611 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-107a4443-c7d8-4bc2-9eea-44e7f086dd26 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012231 May 13 13:42:33.303611 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Fri May 13 13:42:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:34.201695 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-9cfa14dc-615a-4de3-beda-923ca8f35fa2 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:34.202747 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-9cfa14dc-615a-4de3-beda-923ca8f35fa2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 13 13:42:34.203173 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:34.403470 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-6992a3fc-b903-48ef-9aef-680177c061b8 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:34.412706 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-6992a3fc-b903-48ef-9aef-680177c061b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-6992a3fc-b903-48ef-9aef-680177c061b8 admin admin] Request method failure captured: May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept: application/json May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Host: 10.222.0.24 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABifmBKElr0pFZlM88L-I0hSucXrDxD-OmVB3gfvPCLzNDlncmYYmVnKQKji--4ICCCoQ5XHrIkUFbnfk0Wqj4gVK8Wsb4YLwkTGJ2UcwG9HPdxGsRSvCr91cqxocP9sqspJ-u5EptJkOkGaZIgs9myaDZrqaIvqd5aas_UmtCdE6c54zw May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Role: member,admin,reader May 13 13:42:34.414909 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Roles: member,admin,reader May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User: admin May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: method: > May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: exception: Flavor 451 could not be found. May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: action_args: {'id': '451'} May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:34.416765 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:34.417610 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 13 13:42:34.418738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-6992a3fc-b903-48ef-9aef-680177c061b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:34.419738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-6992a3fc-b903-48ef-9aef-680177c061b8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.079292 May 13 13:42:34.419738 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:42:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:34.427216 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3a5aab30-ca3a-4357-8898-94b2e8c81ac8 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:34.440833 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3a5aab30-ca3a-4357-8898-94b2e8c81ac8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017248 May 13 13:42:34.441352 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:34.450871 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:34.465012 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017586 May 13 13:42:34.465570 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Fri May 13 13:42:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:42:34.475285 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ee75dac-1814-47e8-b97f-8173c21d2490 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:34.480908 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-1ee75dac-1814-47e8-b97f-8173c21d2490 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ee75dac-1814-47e8-b97f-8173c21d2490 admin admin] Request method failure captured: May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept: application/json May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Host: 10.222.0.24 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABifmBKElr0pFZlM88L-I0hSucXrDxD-OmVB3gfvPCLzNDlncmYYmVnKQKji--4ICCCoQ5XHrIkUFbnfk0Wqj4gVK8Wsb4YLwkTGJ2UcwG9HPdxGsRSvCr91cqxocP9sqspJ-u5EptJkOkGaZIgs9myaDZrqaIvqd5aas_UmtCdE6c54zw May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Role: member,admin,reader May 13 13:42:34.482434 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Roles: member,admin,reader May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6876099b5cf543bbab2867b6add7a013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6876099b5cf543bbab2867b6add7a013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 6876099b5cf543bbab2867b6add7a013 May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User: admin May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Id: 203d847f7f3b4e1f835fc1f0e7a3286c May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: method: > May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: exception: Flavor 451 could not be found. May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: action_args: {'id': '451'} May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:42:34.483862 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:34.484839 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 13 13:42:34.485881 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ee75dac-1814-47e8-b97f-8173c21d2490 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:42:34.486974 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-1ee75dac-1814-47e8-b97f-8173c21d2490 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012077 May 13 13:42:34.486974 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:42:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:42:35.367105 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:35.368111 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 13 13:42:35.368511 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:35.558910 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e91321e0-94c5-4674-ba13-8625e606696c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:35.580657 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e91321e0-94c5-4674-ba13-8625e606696c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079875 May 13 13:42:35.581131 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 13 13:42:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:36.511427 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:36.512787 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 May 13 13:42:36.513299 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:36.714538 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c7004a22-e396-43d9-b2b5-75eb78d7ca17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:36.734563 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c7004a22-e396-43d9-b2b5-75eb78d7ca17 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085234 May 13 13:42:36.735031 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 13 13:42:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:37.615027 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:37.616030 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 13 13:42:37.616395 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:42:37.808780 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e2985eb8-03d7-4399-a98a-2def433835c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:37.831776 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e2985eb8-03d7-4399-a98a-2def433835c9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.080731 May 13 13:42:37.832360 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 13 13:42:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:38.793729 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:38.794814 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 13 13:42:38.795214 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:38.996152 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-febe0120-2578-416f-885a-9b9796c8df68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:42:39.015159 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-febe0120-2578-416f-885a-9b9796c8df68 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085070 May 13 13:42:39.015726 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Fri May 13 13:42:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:42:39.924800 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:39.925818 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 13 13:42:39.926247 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:42:40.127158 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-40990a85-8513-4e71-87bd-34ea3c39ee70 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:42:40.147191 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-40990a85-8513-4e71-87bd-34ea3c39ee70 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084410 May 13 13:42:40.147730 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Fri May 13 13:42:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:43:42.208031 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.209312 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0690cb46-9618-46d8-a480-133606522863 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001894 May 13 13:43:42.209817 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:43:42.272034 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-50b1610e-91d4-4aef-b45b-084c023ca16b admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.297199 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-50b1610e-91d4-4aef-b45b-084c023ca16b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081059 May 13 13:43:42.297734 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:43:42.320587 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a35b52ec-5177-48dc-bad8-b4284577ebe3 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.329574 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a35b52ec-5177-48dc-bad8-b4284577ebe3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013415 May 13 13:43:42.330112 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:43:42.344474 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-6f80b1a3-2f7d-4bda-9c25-3239325e4021 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.356028 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-6f80b1a3-2f7d-4bda-9c25-3239325e4021 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017532 May 13 13:43:42.356550 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:43:42.368190 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.377118 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012538 May 13 13:43:42.377647 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:43:42.389312 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-78844949-25f4-454d-864c-9d0c89774f59 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:43:42.397143 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-78844949-25f4-454d-864c-9d0c89774f59 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 May 13 13:43:42.397974 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Fri May 13 13:43:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:47:07.040544 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:07.041565 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 13 13:47:07.041962 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:07.332218 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:07.333401 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:07.333401 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:47:07.334910 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:07.335536 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:07.336568 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:07.337011 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:07.372075 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-59ace860-18fa-43a1-988d-2f0f3de4e79e admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.176959 May 13 13:47:07.372647 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:47:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:47:08.326149 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:08.327172 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 13 13:47:08.327628 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:08.523400 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:08.524577 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:08.524577 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:47:08.525763 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:08.526230 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:08.527016 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:08.527438 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:08.546799 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c17c7c0f-6bab-4213-9e99-e1b292388ba8 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078573 May 13 13:47:08.547288 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:47:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:47:19.920930 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:19.922027 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 May 13 13:47:19.922460 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:47:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:20.123687 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:20.124932 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:20.124932 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:47:20.126099 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:20.126562 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:20.127329 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:20.127742 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:20.152089 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3f4753e5-fe8b-4fca-947f-f36ebed257cd admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089076 May 13 13:47:20.152673 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:47:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:47:21.057154 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:21.058789 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c457692e-37d5-4460-8256-a256c9074af5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 May 13 13:47:21.059387 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Fri May 13 13:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:21.264310 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:21.265598 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:21.265598 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 13 13:47:21.266843 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:21.267306 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:21.268101 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:47:21.268527 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:47:21.291068 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-bbde2715-7617-48e4-9eae-92013e93b5e9 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095579 May 13 13:47:21.291618 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Fri May 13 13:47:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:20.983783 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: Fri May 13 13:48:20 2022 - graceful shutdown triggered... May 13 13:48:20.983511 dv-cinder-795785-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 13:48:20.984824 dv-cinder-795785-8-iscsi devstack@n-api.service[109606]: Gracefully killing worker 1 (pid: 109606)... May 13 13:48:20.985367 dv-cinder-795785-8-iscsi devstack@n-api.service[109607]: Gracefully killing worker 2 (pid: 109607)... May 13 13:48:21.984670 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: worker 1 buried after 1 seconds May 13 13:48:21.984670 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: worker 2 buried after 1 seconds May 13 13:48:21.984670 dv-cinder-795785-8-iscsi devstack@n-api.service[109605]: goodbye to uWSGI. May 13 13:48:21.987259 dv-cinder-795785-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 13:48:21.988170 dv-cinder-795785-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 13:48:21.992328 dv-cinder-795785-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:48:22.018352 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:48:22 2022] *** May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: nodename: dv-cinder-795785-8-iscsi May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: machine: x86_64 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: clock source: unix May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: pcre jit disabled May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: detected number of CPU cores: 4 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: current working directory: / May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: detected binary path: /usr/bin/uwsgi-core May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: your processes number limit is 47680 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: your memory page size is 4096 bytes May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: detected max file descriptor number: 2048 May 13 13:48:22.042648 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: lock engine: pthread robust mutexes May 13 13:48:22.043634 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: thunder lock: enabled May 13 13:48:22.043634 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:48:22.043634 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:48:22.088160 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: Python main interpreter initialized at 0x5599e21b99c0 May 13 13:48:22.088160 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: python threads support enabled May 13 13:48:22.088160 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: your server socket listen backlog is limited to 100 connections May 13 13:48:22.088160 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: your mercy for graceful operations on workers is 90 seconds May 13 13:48:22.088635 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:48:22.088635 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: *** Operational MODE: preforking *** May 13 13:48:22.088859 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: *** uWSGI is running in multiple interpreter mode *** May 13 13:48:22.088859 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: spawned uWSGI master process (pid: 123940) May 13 13:48:22.089081 dv-cinder-795785-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:48:22.089937 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: spawned uWSGI worker 1 (pid: 123954, cores: 1) May 13 13:48:22.090085 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: spawned uWSGI worker 2 (pid: 123955, cores: 1) May 13 13:48:22.090166 dv-cinder-795785-8-iscsi devstack@n-api.service[123940]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:48:23.276404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:48:23.318810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:48:24.068691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:48:24.068691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: from cryptography.utils import int_from_bytes May 13 13:48:24.068986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:48:24.068986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: from cryptography.utils import int_from_bytes May 13 13:48:24.131000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:48:24.131000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: from cryptography.utils import int_from_bytes May 13 13:48:24.131286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:48:24.131286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: from cryptography.utils import int_from_bytes May 13 13:48:26.477539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:48:26.478156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:48:26.478374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:48:26.478743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:48:26.479010 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:48:26.479403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.479735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.480059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.480383 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.480716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.481034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.481361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.481686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.482018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.482312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.482633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.482958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-8-iscsi {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.483286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.483598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.483920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.484236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.484548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.484870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.485182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.485682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.487761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.488229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.488542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.488875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.489190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.489597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-8-iscsi {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.489919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.490269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.490585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.491008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.491333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.491637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.491962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.492289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.492586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.493154 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.493488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.493814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.494167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.494480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.494796 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.495122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.495435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.495747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.496056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.497841 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.498970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.498970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.498970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.498970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.499322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.499609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.499919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.500234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.500544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.500855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.501166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.501490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.501811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.502169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.502493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.502862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.503407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.503665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.503982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.504314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.504638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.504952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.505276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.505602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.505917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.506256 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.506575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.506902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.507245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.507543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.507801 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.508112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.508423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.508751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.509064 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.509376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.509693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.510003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.510343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.510658 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.510973 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.511286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.511598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.511909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.512225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.512540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.512854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.513179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.513505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.513819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.514155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.514471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.514785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.515110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.515422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.515736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.516060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.516373 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.516689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.517013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.517324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.517638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.517964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.518347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.518667 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.518988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.519301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.519613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.519925 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.520235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.520545 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.520854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.521163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.521530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.521776 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.522126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.522456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.522773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.523495 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.523730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.524054 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.524623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.524965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.525314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.525634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.525980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.526344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.526655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.526976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.527295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.527623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.528110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.528434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.528761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.529087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.529412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.529747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.530173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.530416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.530739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.531056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.531409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.531738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.532065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.532379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.532727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.533073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.533394 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.533719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.534134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.534454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.534792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.535092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.535411 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.535841 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.536158 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.536482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.536799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.537101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.537416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.537837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.538061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.538418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.538743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.539062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.539788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.539788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.540157 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.540656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.540656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.541061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.541222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.541475 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.541789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.542123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.542454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.542787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.543100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.544514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.544514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.544514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.544514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.545144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.545144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.545456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.545698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.545856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.546215 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.546538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.546897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.547173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.547473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.547784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.548130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.548407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.548724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.549038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.549418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.549693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.550016 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.550357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.550722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.551172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.551375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.551676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.552003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.552325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.552632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.552947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.553252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.553557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.553830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.554189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.554499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.554800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.555118 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.555420 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.555750 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.556049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.556356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.556666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.557029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.557290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.557632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.557943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.558313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.558647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.558975 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.559301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.559628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.559935 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.560253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.560566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.560880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.561178 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.561490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.561806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.562221 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.562470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.563099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.563099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.563417 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.563709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.564059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.564528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.564702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.565026 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.565485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.565812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.566106 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.566381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.566668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.566982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.567299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.567624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.567940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.568367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.568582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.568909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.569224 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.569544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.569855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.570195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.570530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.570867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.571181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.571499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.571851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.572131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.572442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.572744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.573055 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.573365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.573678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.573996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.574337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.574653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.574963 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.575282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.575593 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.575900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.576208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.576522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.576845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.577159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.577484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.577806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.578138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.578508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.578769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.579084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.579393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.579700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.580006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.580346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.580694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.581022 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.581407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.581746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.582082 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.582475 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.582717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.583031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.583357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.583708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.584111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.584294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.584594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.584907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.585223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.585550 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.585864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.586258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.586514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.586820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.587159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.587454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.588044 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.588379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.588702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.589024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.589345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.589669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.590101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.590359 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.590709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.591020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.591335 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.591644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.591958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.592270 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.592588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.592880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.593187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.593499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.593817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.594185 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.594436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.594599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:48:26.595117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.595275 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:48:26.595420 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.595420 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.595713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:48:26.595869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.596014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:48:26.596158 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.596328 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:48:26.596592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.596818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.597080 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.597344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.597518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.597751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.597983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.598180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.598343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.598497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.598641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.598895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.599046 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.599210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.599363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.599508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.599663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.599808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.599808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.600089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.600331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.600489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.600489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.600764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-8-iscsi {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.600920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.601084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.601824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.601993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.602214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.602472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.602779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.602939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.603123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.603282 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.603429 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.603573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.603730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.603896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.604115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.604274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.604454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.604615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.604759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.604903 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.605056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.605200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.605343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.605501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.605655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.605799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.605950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.606137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.606310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.606476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.606714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.606872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.607025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.607025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.607310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.607468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.607722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.607976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.608192 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-8-iscsi {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.608358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.608505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.608670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.608815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.609065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.609228 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.609457 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.609613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.609946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.610560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.610758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.610939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.611134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.611599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.611782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.612064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.612317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.612842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.613046 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.613237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.613418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.613607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.613788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.613985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.614305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.614498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.614678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.614878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.615058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.615248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.615440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.615620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.615799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.615978 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.616166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.616356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.616536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.616805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.616999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.617180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.617380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.617564 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.617745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.618001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.618315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.618510 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.618697 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.618876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.619161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.619324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.619502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.619657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.619829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.619974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.620135 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.620297 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.620455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.620700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.620852 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.620996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.621139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.621282 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.621426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.621598 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.621799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.621964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.622152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.622299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.622449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.622606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.623025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.623187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.623333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.623478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.623637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.623790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.623936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.624091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.624251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.624478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.624636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.624782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.624936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.625087 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.625232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.625384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.625543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.625687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.625830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.625991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.628929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.629122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.629603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.629764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.629926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.630093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.630247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.630392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.630556 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.630727 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.630956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.631115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.631272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.631445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.631591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.631744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.631889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.632042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.632186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.632345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.632345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.632628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.632772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.632932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.633340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.633513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.633667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.633812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.633955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.634145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.634296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.634474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.634719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.634875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.635021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.635164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.635323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.635476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.635640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.635784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.635928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.636083 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.636244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.636388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.636533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.636686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.636842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.636986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.637144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.637295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.637446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.637605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.637768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.637996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.638183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.638435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.638659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.638808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.638952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.639112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.639266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.639419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.639419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.639851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.639851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.640175 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.640175 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.640460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.640460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.640753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.640905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.641136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.641293 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.641446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.641610 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.641765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.641916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.642188 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.642378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.642526 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.642688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.642843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.642995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.643652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.643850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.644005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.644168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.644315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.644459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.644624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.644865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.645031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.645177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.645329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.645473 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.645623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.645769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.646002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.646201 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.646347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.646491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.646491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.646777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.646934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.647092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.647237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.647381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.647533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.647700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.648222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.648470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.648770 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.648921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.649093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.649444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.649608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.649755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.650016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.650198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.650354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:48:26.650513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.650659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.650812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.650957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.651945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.652985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.654880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.655875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.656852 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657448 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.657887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.658203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.658203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.658599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.659045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.659281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.659281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.659710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.659870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660178 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660326 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.660958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.661220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.661470 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.661622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.661768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.661931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.662928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.663089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.663247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.663498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.663675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.663905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664176 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.664979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.665490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.665654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.665809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.665967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.666171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.666409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.666582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.666745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.666906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.667895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.668047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.668222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.668383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.668546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.668795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669268 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669586 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.669899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670411 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.670888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.671041 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.671220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.671477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.671712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.671869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672506 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.672988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.673148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.673309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.673494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.673713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.673888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.674179 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.674359 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.674690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.674973 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.675246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.675558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.675745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.675899 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.676894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677059 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677221 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.677866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.678969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.679226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.679467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.679635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.679788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.679938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680362 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680628 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680899 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.680987 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.681940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682444 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682898 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.682898 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683642 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683838 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.683997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.684945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.685835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.686955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687037 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687616 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687832 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.687994 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688217 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688296 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.688841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689373 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689779 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.689922 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.690740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.691933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.692977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693444 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693681 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.693904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.694071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.694163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.695531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.695639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.695908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.695998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696470 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.696997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697462 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697684 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.697855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698572 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.698965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.699990 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700061 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700061 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700277 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700450 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700616 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.700920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701444 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701517 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.701955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702033 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702211 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.702678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703355 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703516 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.703991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.704285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.704403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.704488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.704741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.704830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705774 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.705932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.706969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707236 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.707938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708217 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.708823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709795 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.709931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.710996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.711150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.711715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.711813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.711890 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.711982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.712871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.713959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714297 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714382 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714705 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.714999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715527 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.715959 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.716131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.716443 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.716638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.716944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.717025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.717248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.717562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.717652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.717872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.719799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.719999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.719999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.720958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.721255 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.721568 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.721568 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.721568 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.722762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.723028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.723949 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724594 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724594 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.724883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.725052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.725052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.725357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.725508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.725659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.726180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.726180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.726630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.726788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.726788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.727078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.727244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.727244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.727681 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.727992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.728772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.729123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.729123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.729570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.729957 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730478 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730796 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.730948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.731107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.731267 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.731427 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.731605 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.731891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732059 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732702 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.732863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.733017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.733167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.733318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.733676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.733951 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.734988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735293 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.735915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.736221 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.736390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.736549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.736796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.737036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.737262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.737262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.737753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.737959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.738183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.738425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.738581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.738743 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.738897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.739845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.740936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.741894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.742171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.742486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.742659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.742814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.742973 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.743132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.743295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.743451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.744498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.744661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.744815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.744990 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745473 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.745946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.746163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.746484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.746640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.746640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.747937 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748558 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.748861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.749968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.750233 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.750389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.750552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.750704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.750859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.751856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.752109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.752460 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.752724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.752947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.753187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.753442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.753714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.754201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.754383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.754692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.754854 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.755972 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.756661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.757989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.759198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.760504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.761687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.762995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.763608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.763608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.763608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.764164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.764283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.764503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.764806 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.765146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.765452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.765774 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.766122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.766493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.767935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.767935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.767935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.767935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.768301 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.768460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.768934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.769097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.769372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.769657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.769973 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.770296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.770607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.770909 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.771211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.771513 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.771835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.772139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.772460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.772775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.773429 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.773734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.773878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:26.774188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.774401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.774707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.775063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.775366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.775686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.776019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.776329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.776654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.776972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.777284 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.777599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.777915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.778262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.778578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.778892 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.779202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.779519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.779834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.780154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.780717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.781055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.781370 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.781683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.781998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.782346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.782665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.782976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.783289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.783599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.784038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.784450 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.784848 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.785191 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.785534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.785853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.786192 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.786512 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.786825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.787182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.787499 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.787805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.788116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.788431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.788740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.789050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.789358 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.789667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.789979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.790319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.790630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.790940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.791253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.791579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.791940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.792230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.792545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.792882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.793166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.794570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.794894 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.795239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.795563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.795891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.796212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.796530 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.796861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.797175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.797481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.797791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.798125 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.798438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.798765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.799076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.799398 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.799897 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.800234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.800777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.801126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.801443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.801769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.802118 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.802439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.802754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.803080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.803384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.803689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.804004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.804316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.804620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.804923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.805232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.805545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.805849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.806191 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.806497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.806824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.807129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.807435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.807735 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.808048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.808349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.808700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.808956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.809259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.809571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.809875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.810211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.810518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.810831 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.811138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.811446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.811801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.812123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.812429 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.812738 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.813079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.813366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.813687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.813996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.814333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.814684 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.815000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.815671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.816177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.816504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.816842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.817177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.817489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.817796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.818128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.818455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.818771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.819085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.819394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.819702 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.820012 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.820319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.820645 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.820955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.821266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.821574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.821882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.822215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.822530 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.822877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.823187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.823509 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.823825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.824141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.824452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.824761 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.825069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.825376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.825691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.826019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.826354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.826657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.827082 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.827394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.827714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.828035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.828343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.828665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.828990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.829299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.829618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.830682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.830682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.830682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.831086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.831391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.831698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.832004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.832310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.832621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.832947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.833254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.833698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.834003 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.834337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.834643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.834952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.835254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.835556 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.835865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.836166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.836467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.836771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.837073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.837373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.837679 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.837986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.838426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.838729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.839035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.839337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.839638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.839969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.840302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.840614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.840935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.841248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.841567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.841875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.842219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.842541 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.842860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.843168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.843268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.context [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bbb2759-67a0-478c-9905-0185ee945b1d(cell1) {{(pid=123955) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:48:26.843502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.843815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.844123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.844434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.844741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.845049 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.845359 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.845683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.846006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.846390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.846723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.847040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.847359 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.847689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.847986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.848099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:48:26.848313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.848625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.848932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.849247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.849555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.849653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:48:26.849865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.850205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.850504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:48:26.850692 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.850832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.851155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.851465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.851788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.852114 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.852467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.852568 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:48:26.852784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.853126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.853451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.853787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.854085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.854393 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:48:26.854635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:48:26.866465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:26.867096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:26.878342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_db.sqlalchemy.engines [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:26.942365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.context [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bbb2759-67a0-478c-9905-0185ee945b1d(cell1) {{(pid=123954) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:48:26.946809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:48:26.948448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:48:26.949330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:48:26.951408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:48:26.962810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_db.sqlalchemy.engines [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:26.968420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_db.sqlalchemy.engines [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:27.036278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:27.126580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_db.sqlalchemy.engines [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:48:27.364851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: WARNING keystonemiddleware.auth_token [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:48:27.372786 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: WARNING keystonemiddleware.auth_token [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:48:27.442829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: WARNING keystonemiddleware.auth_token [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:48:27.450818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: WARNING keystonemiddleware.auth_token [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:48:27.727108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: WARNING keystonemiddleware.auth_token [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:48:27.733475 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: WARNING keystonemiddleware.auth_token [None req-fa3a4c16-9ab9-4165-8af9-d74788eecbe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:48:27.740528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599e21b99c0 pid: 123955 (default app) May 13 13:48:27.793096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: WARNING keystonemiddleware.auth_token [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:48:27.799576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: WARNING keystonemiddleware.auth_token [None req-3d558d87-1de9-41e2-be5d-61f8f9bd6e98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:48:27.804799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599e21b99c0 pid: 123954 (default app) May 13 13:49:12.700999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1097534401", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "networks": [{"uuid": "4ad8d21a-1f7f-470a-85b7-b47661584706"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:13.760500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] validate_networks() for [('4ad8d21a-1f7f-470a-85b7-b47661584706', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:49:16.317929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:49:16.318592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:49:16.319698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:49:16.320273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:49:16.320909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:49:16.368968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:16.369814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:16.371140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:16.371777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:16.441058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Getting quotas for project 45d6e24fd6ed4e629115e136441c159f. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:16.450543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Getting quotas for user 258595798e7742bbb3e34cfdd7fdeb7c and project 45d6e24fd6ed4e629115e136441c159f. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:16.520076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:49:16.559695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:49:16.702855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-299da0ee-63c9-4fc6-bd30-54ea78833db6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.453942 May 13 13:49:16.703500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:49:17.061868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-701885f7-6d18-4331-8369-01f23f40dc8f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:17.062624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-701885f7-6d18-4331-8369-01f23f40dc8f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:18.631294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-701885f7-6d18-4331-8369-01f23f40dc8f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:18.662452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-701885f7-6d18-4331-8369-01f23f40dc8f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1215 microversion: 2.1 time: 1.951517 May 13 13:49:18.665194 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 1/2] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:16 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1215 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:19.681436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:19.682771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:19.724832 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:19.726774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:19.728290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:19.732392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:20.239996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:20.270115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dabfe47b-4c30-40be-bc62-d73a045fee76 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1211 microversion: 2.1 time: 0.592875 May 13 13:49:20.272676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:19 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1211 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:21.201309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-993de87a-c58a-4403-9e54-40a600e5039b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: .version_select at 0x7ff155f17f70>, body: {"keypair": {"name": "tempest-keypair-1929469743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT9oqCS0qONIYozp6ANnQ6pH6GB8dkzDPa0N6MxL1h6gdYT958+vEvvZ3vAHRRcwpE+puOh4LGgfFWKA51lTbkZvloGrUpmHK9UD/M81OinerguusTlU2UcsilIZpWv7Q=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:21.290127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:21.290739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:21.299391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:21.300895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:21.305481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-993de87a-c58a-4403-9e54-40a600e5039b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:21.305969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:21.306601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:21.327579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-993de87a-c58a-4403-9e54-40a600e5039b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for user 35c45393e3054bc3a1417fc23e721853 and project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:21.474941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-993de87a-c58a-4403-9e54-40a600e5039b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.558874 May 13 13:49:21.476364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 2/4] 10.222.0.24 () {62 vars in 1199 bytes} [Fri May 13 13:49:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 561 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 13:49:21.609313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:21.624764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9e16b41a-3378-44ee-b9c3-89f2c33df6aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1267 microversion: 2.1 time: 0.336005 May 13 13:49:21.625888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 3/5] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:21 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1267 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:22.643768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:22.645497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:22.662280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:22.662732 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:22.667923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:22.669950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:23.045511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:23.077097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a56e6b14-0e8b-470d-a184-fc61a45082ef tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1267 microversion: 2.1 time: 0.435313 May 13 13:49:23.090376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 3/6] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:22 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:24.094189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:24.094802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:24.105848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:24.106553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:24.107477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:24.108041 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:24.243462 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:24.255607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-99d9ecb4-c3dd-46a7-b7e2-7d8489b18456 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1267 microversion: 2.1 time: 0.165121 May 13 13:49:24.256139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:24 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:25.275543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:25.277377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:25.291313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:25.298652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:25.299647 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:25.300305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:25.439696 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:25.456127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a2b36234-af83-419a-9a3e-dcbd7bcd33ee tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1275 microversion: 2.1 time: 0.187132 May 13 13:49:25.467066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:25 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:25.961664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-356956202", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18373f82-18bd-4634-b9ff-f547598d414b"}], "security_groups": [{"name": "tempest-securitygroup--1381650793"}], "key_name": "tempest-keypair-1929469743", "user_data": "}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:26.460307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] validate_networks() for [('18373f82-18bd-4634-b9ff-f547598d414b', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:49:26.474305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:26.474920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:26.484064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:26.489981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:26.490978 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:26.491489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:26.679235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:26.687053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fe8e6ccb-bfdc-4b47-892e-04fe3ff6a994 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1273 microversion: 2.1 time: 0.217543 May 13 13:49:26.692414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 5/9] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:26 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:27.475899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1958980866", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:27.645842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] validate_networks() for [('778c21a5-ff96-4fce-8d43-b8a6076c8622', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:49:30.777422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:49:30.782722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:49:30.783321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:49:30.783802 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:49:30.784304 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:49:30.813064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:30.813772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:30.819131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:30.824048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:30.911551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:30.925943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for user f9ca490113764eba85daa6ca9fbba5f5 and project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:30.963603 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:49:30.974364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:49:31.130385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68cd8cef-4053-4f59-a320-8cc503b8274d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.436753 May 13 13:49:31.131488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 6/10] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:49:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:49:31.140764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:31.141390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:31.163851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:31.167037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:31.167927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:31.168373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:31.577688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:31.606460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cc82fce4-92ac-43c4-8853-bd4f82f50094 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.474109 May 13 13:49:31.607567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 7/11] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:31 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:31.613902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-29a6bd79-483b-455e-b18b-6b0365b29626 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:31.614856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-29a6bd79-483b-455e-b18b-6b0365b29626 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:31.818156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-29a6bd79-483b-455e-b18b-6b0365b29626 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:31.828021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-29a6bd79-483b-455e-b18b-6b0365b29626 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1222 microversion: 2.1 time: 0.216312 May 13 13:49:31.858419 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 8/12] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:31 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:31.882646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:49:31.883128 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:49:31.883495 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:49:31.884070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:49:31.884617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:49:31.921070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:31.923666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:31.931313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:31.931764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:32.009141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:32.019325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for user 35c45393e3054bc3a1417fc23e721853 and project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:32.084770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:49:32.105042 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:49:32.273305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366873583", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:32.282837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-935ec4e6-48b4-445d-bf77-0a617f813247 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.325941 May 13 13:49:32.298968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 5/13] 10.222.0.24 () {62 vars in 1187 bytes} [Fri May 13 13:49:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 6343 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 13:49:32.305477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:32.306549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:32.432448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] validate_networks() for [('778c21a5-ff96-4fce-8d43-b8a6076c8622', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:49:32.476021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:32.502354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:32.526676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:32.528547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-49f6fc57-082f-4a66-9642-1bf8b14891e1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1281 microversion: 2.20 time: 0.228236 May 13 13:49:32.541401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 6/14] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:32 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:32.624150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:32.624776 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:32.636460 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:32.645776 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:32.648951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:32.649625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:33.694335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:49:33.694849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:49:33.695649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:49:33.696159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:49:33.696707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:49:33.701783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:33.713267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6e3b8fc2-75f6-4807-b93a-3b398f564eab tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 1.092946 May 13 13:49:33.713863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 7/15] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:32 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:33.722968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:33.723479 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:33.731230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:33.735217 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:33.745853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:33.746524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:33.802160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:33.817363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for user f9ca490113764eba85daa6ca9fbba5f5 and project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:33.856035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:49:33.863956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:49:33.961987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:33.985194 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:33.992400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:33.997320 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2506221a-568b-4fa9-a502-d9ea2f759040 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1281 microversion: 2.20 time: 0.274882 May 13 13:49:33.999848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 8/16] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:33 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:34.000638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c585e69b-4a6b-463f-a2b7-17ff07d62992 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.732392 May 13 13:49:34.001481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 9/17] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:49:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:49:34.013011 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c13c279c-1377-4e24-8704-95218af88b83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:34.041383 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c13c279c-1377-4e24-8704-95218af88b83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:34.253499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c13c279c-1377-4e24-8704-95218af88b83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:34.261936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c13c279c-1377-4e24-8704-95218af88b83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1221 microversion: 2.1 time: 0.253854 May 13 13:49:34.262581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 9/18] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:34 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:34.735625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:34.743282 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:34.772809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:34.773920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:34.780656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:34.781407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:35.020432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:35.021837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:35.035441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:35.043627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:35.048840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:35.063207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:35.250235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:35.264971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-845531d0-9b33-42ca-a432-ea75e191d496 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.537160 May 13 13:49:35.268585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 10/19] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:34 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:35.899967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4fa6f3db-94b0-4d3a-b02a-f64c9b0918fe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: .version_select at 0x7ff1555b5550>, body: {"keypair": {"name": "tempest-keypair-2006578398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd8D/dRTO2GJbn7sPAyI7ueTmKyVLskGSn5HD9aRrIFI4AIlj8sfbgYW9noJwXC7aqZMsVx/6vher6urvdXe02BkfZWQ633DnX4ozzgkByVuozVYh/dXGqP/2JxtmPTnw=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:35.937136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:35.950139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:35.959455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:35.961889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-4fa6f3db-94b0-4d3a-b02a-f64c9b0918fe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for project b55a828bec5e46079d85da062846e17e. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:35.966238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-09461211-1bef-4d4e-a8bf-837a2084b09e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1333 microversion: 2.20 time: 0.947946 May 13 13:49:35.967096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 10/20] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:35 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1333 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:35.974839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:35.978888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-4fa6f3db-94b0-4d3a-b02a-f64c9b0918fe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for user f789eaddc18244e0a1f8246e6eb21991 and project b55a828bec5e46079d85da062846e17e. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:35.987754 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:36.043748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:36.044362 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:36.054156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:36.054624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:36.073715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4fa6f3db-94b0-4d3a-b02a-f64c9b0918fe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.798415 May 13 13:49:36.081571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 11/21] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:49:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:36.287586 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:36.288557 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:36.305734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:36.306481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:36.307573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:36.309909 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:36.470367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:36.511129 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2e52aa61-33d7-45cf-9e09-8ba85f6afdc1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1273 microversion: 2.1 time: 0.535360 May 13 13:49:36.514398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 11/22] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:35 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1273 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:37.085982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:37.095540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d24907af-00eb-44e6-a2d8-63c2709fcae7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.813101 May 13 13:49:37.100703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 12/23] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:36 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:37.107601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:37.114749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:37.135747 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.136963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.138544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.140158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.464757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-304528c0-236f-4b14-865e-7d9c721d199c req-cbb7aaea-ee49-4440-b1fb-b2c1c7f584a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe8806f-ef13-4621-9dea-850cdab53624", "tag": "1463c1e5-8ddd-4a01-b534-d61cc17637a8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:37.536112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-304528c0-236f-4b14-865e-7d9c721d199c req-cbb7aaea-ee49-4440-b1fb-b2c1c7f584a9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.537147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-304528c0-236f-4b14-865e-7d9c721d199c req-cbb7aaea-ee49-4440-b1fb-b2c1c7f584a9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.617387 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-304528c0-236f-4b14-865e-7d9c721d199c req-cbb7aaea-ee49-4440-b1fb-b2c1c7f584a9 service nova] Creating event network-changed:1463c1e5-8ddd-4a01-b534-d61cc17637a8 for instance 5fe8806f-ef13-4621-9dea-850cdab53624 on hv-cinder-79578 May 13 13:49:37.619013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-304528c0-236f-4b14-865e-7d9c721d199c req-cbb7aaea-ee49-4440-b1fb-b2c1c7f584a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:49:37.632023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.632627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.636598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.637981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.673230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.compute.rpcapi [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:49:37.676453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] Releasing lock "compute-rpcapi-router" {{(pid=123955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:49:37.708418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e3281b13-f093-44ab-be7e-592f43b3dd15 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.192445 May 13 13:49:37.709813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 12/24] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:37.718611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:37.719860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:37.736660 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.737668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:37.738833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:37.739538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:38.135214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:38.144584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0ae02015-30e0-4a19-a2af-37c57b758ad8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1279 microversion: 2.1 time: 0.432815 May 13 13:49:38.158390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 13/25] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:37 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1279 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:38.185079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:38.186917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:38.210761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:38.216870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:38.217837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:38.220185 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:38.689788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:38.714891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:38.716765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:38.717934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2fb47f78-6f0b-4a38-8685-02d02303c212 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 1.615942 May 13 13:49:38.718549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 13/26] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:37 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:39.041554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:39.055493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e67c3431-fe6a-4baf-a99c-a9cf944e7870 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.895299 May 13 13:49:39.071851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 14/27] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:38 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:39.167554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:39.172138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:39.182698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:39.184692 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:39.187208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:39.188423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:39.406485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:39.429870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7f2aabdd-51fe-4fff-b570-34c4822adecb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1279 microversion: 2.1 time: 0.267243 May 13 13:49:39.436904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 14/28] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:39 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:39.743839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:39.744467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:39.757809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:39.758289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:39.759081 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:39.759520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:40.057800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:40.071116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:40.072830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:40.074216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:40.074528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:40.075932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-926cb6bb-2b76-420f-a860-c590ad982b91 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.339200 May 13 13:49:40.084104 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 15/29] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:39 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:40.089127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:40.089981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:40.093578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:40.101372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:40.451050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:40.451914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:40.469889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:40.470532 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:40.471489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:40.472310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:40.553434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:40.561717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ec467be1-4d23-41f1-8230-37a1c2e13143 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.493701 May 13 13:49:40.571520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 15/30] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:40 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:40.750293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:40.767464 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-906a2568-b66b-42d6-858e-fc3d23ab3eed tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.319967 May 13 13:49:40.777118 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 16/31] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:40 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:41.099085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:41.100390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:41.109096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.113488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:41.114579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.115134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:41.356494 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:41.370856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:41.372907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:41.374540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7cd79833-3d94-45fb-8967-dd7fb8136960 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.281643 May 13 13:49:41.389040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 16/32] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:41 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:41.550336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1027781027", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8904d1e8-57c1-4669-957b-1076c1fb91b9"}], "security_groups": [{"name": "tempest-securitygroup--486079715"}], "key_name": "tempest-keypair-2006578398", "user_data": "}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:41.577728 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:41.578368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:41.584399 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.585023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:41.606510 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.607722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:41.759482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] validate_networks() for [('8904d1e8-57c1-4669-957b-1076c1fb91b9', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:49:41.953920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:41.963870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0565a1e5-76f8-4138-a0c1-7e993da765a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.389838 May 13 13:49:41.965109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 17/33] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:41 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:41.980684 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:41.981401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:41.988865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.989575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:41.990637 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:41.991368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.248990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:42.260837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7afe5b78-fe73-433b-abfb-7dda2b4083ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.292536 May 13 13:49:42.261551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 18/34] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:41 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:42.392899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:42.393706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:42.400576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.401368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.402399 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.403035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.586607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:42.601883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:42.603662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:42.607482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-50ab7950-fda0-4e72-95c5-233984a48f70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.218589 May 13 13:49:42.612152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 19/35] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:42 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:42.697265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:49:42.697791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:49:42.698229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:49:42.698860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:49:42.699272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:49:42.713110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.713590 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.717784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.718281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.743324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for project b55a828bec5e46079d85da062846e17e. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:49:42.752850 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for user f789eaddc18244e0a1f8246e6eb21991 and project b55a828bec5e46079d85da062846e17e. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:49:42.775672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:49:42.798520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:49:42.873558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a387b1c8-202b-4f80-895c-bc13d3ba0304 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.329404 May 13 13:49:42.874613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 17/36] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:49:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:49:42.886935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a1aedddc-ea94-4872-a54d-101c80d44275 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:42.887797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a1aedddc-ea94-4872-a54d-101c80d44275 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:42.962289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a1aedddc-ea94-4872-a54d-101c80d44275 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:42.978107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a1aedddc-ea94-4872-a54d-101c80d44275 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1238 microversion: 2.1 time: 0.093371 May 13 13:49:42.983077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:42.983704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:42.986705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 20/37] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:42 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:42.997494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.997952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:42.998987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:42.999430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:43.169354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:43.178108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7474038b-11c1-444a-a825-c74de6020937 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.200216 May 13 13:49:43.178684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 18/38] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:42 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:43.282123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:43.283502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:43.290209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:43.290665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:43.291452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:43.291893 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:43.426184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:43.434242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e3284dc6-ff46-4e8e-912e-6792b4d93cf6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.158110 May 13 13:49:43.434803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 21/39] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:43 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:43.634232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:43.635152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:43.645413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:43.646225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:43.647701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:43.649259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:43.792252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:43.801073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:43.802608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:43.803707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-176d8e9e-9562-4e0c-a3d0-e9ff80414c30 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.176304 May 13 13:49:43.804239 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 19/40] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:43 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:43.993566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:43.994209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:44.000421 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.000858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.001666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.002130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.069975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.077579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d5cacb36-69fd-4e38-81a6-75da74e21d56 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1242 microversion: 2.1 time: 0.087945 May 13 13:49:44.078522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 22/41] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:43 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:44.194552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:44.195165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:44.201232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.201709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.202516 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.202964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.336284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.344970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fb1b1b29-4630-4db0-9c6e-c743552307af tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.154509 May 13 13:49:44.345549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 20/42] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:44 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:44.454331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:44.455339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:44.466412 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.467130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.468440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.469170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.598030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.605425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-30c5498a-481e-4a73-acef-cf8589608b24 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.157499 May 13 13:49:44.605993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 23/43] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:44 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:44.820991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:44.821571 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:44.828059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.828505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.829277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:44.829707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:44.977350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.988573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.990118 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:44.991250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a1c03073-afb6-4977-8e72-11f1abe08253 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.174257 May 13 13:49:44.995520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 21/44] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:44 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:45.095744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:45.096352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:45.103005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.103463 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.104227 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.104680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.185408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:45.196635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-94f6f392-28e4-4e95-bd9a-ce5aec5de312 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1242 microversion: 2.1 time: 0.104785 May 13 13:49:45.197664 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 24/45] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:45 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:45.365089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:45.367400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:45.380006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.380619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.381507 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.382848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.623169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:45.623771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:45.635845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.638025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.639852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:45.641251 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:45.687436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:45.700454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3f5ec88f-a17c-4cac-b80a-a2fedeeacfd7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.342130 May 13 13:49:45.703888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 22/46] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:45 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:46.009788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:46.012312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:46.025318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.027233 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.049414 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.050081 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.160278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:46.170800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4f868fa1-2874-4aa4-bc1a-a07488f9edf8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.551413 May 13 13:49:46.172001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 25/47] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:45 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:46.215485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:46.218743 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:46.229160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.230094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.231442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.232078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.273570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:46.282767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:46.284294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:46.285508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c3d62d39-ff6d-4a5c-854b-3ec76595abc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.279668 May 13 13:49:46.285942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 23/48] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:46 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:46.407624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:46.416317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3a9c69d8-85a6-4b23-8f61-6dd024f2e85a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.207309 May 13 13:49:46.430103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 26/49] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:46 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:46.724471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:46.725442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:46.734593 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.736004 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.737012 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.737770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:46.927918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-51069268-8619-4209-b8e3-3304d7298246 req-2a756c28-3927-4dbd-949b-280c7c38347b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361ca01b-bda3-4060-a318-72a052700b32", "tag": "0c30fb69-0384-45e4-b5b2-d0ee5152cea8"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:46.960438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-51069268-8619-4209-b8e3-3304d7298246 req-2a756c28-3927-4dbd-949b-280c7c38347b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:46.961240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-51069268-8619-4209-b8e3-3304d7298246 req-2a756c28-3927-4dbd-949b-280c7c38347b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.017633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-51069268-8619-4209-b8e3-3304d7298246 req-2a756c28-3927-4dbd-949b-280c7c38347b service nova] Creating event network-changed:0c30fb69-0384-45e4-b5b2-d0ee5152cea8 for instance 361ca01b-bda3-4060-a318-72a052700b32 on hv-cinder-79578 May 13 13:49:47.020454 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-51069268-8619-4209-b8e3-3304d7298246 req-2a756c28-3927-4dbd-949b-280c7c38347b service nova] Acquired lock "compute-rpcapi-router" {{(pid=123954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:49:47.024477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.025662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.026714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.031043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.057290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.compute.rpcapi [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:49:47.061117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] Releasing lock "compute-rpcapi-router" {{(pid=123954) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:49:47.111228 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5f544978-d9a5-4fa6-8375-a6ad4ec41359 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188110 May 13 13:49:47.119394 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.121580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 27/50] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:47.131300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b1dda9f8-c077-41dc-acac-2dd16bebffe6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.412394 May 13 13:49:47.134247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 24/51] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:46 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:47.188592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:47.189542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:47.196542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.197078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.197931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.198652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.221993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-e4e6f5d0-c249-4ef7-a0fb-e1de865896a2 req-e82c95f9-2a5b-45af-8326-538311a0c487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:47.230884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-e4e6f5d0-c249-4ef7-a0fb-e1de865896a2 req-e82c95f9-2a5b-45af-8326-538311a0c487 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.231322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-e4e6f5d0-c249-4ef7-a0fb-e1de865896a2 req-e82c95f9-2a5b-45af-8326-538311a0c487 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.249167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-e4e6f5d0-c249-4ef7-a0fb-e1de865896a2 req-e82c95f9-2a5b-45af-8326-538311a0c487 service nova] Creating event network-changed:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:49:47.255052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-e4e6f5d0-c249-4ef7-a0fb-e1de865896a2 req-e82c95f9-2a5b-45af-8326-538311a0c487 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112557 May 13 13:49:47.259781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 28/52] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:47.310895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:47.311606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:47.318284 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.318940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.319860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.320453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.364677 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.379087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-372d937c-541b-4e85-97ac-21ea6f09587a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.194481 May 13 13:49:47.379663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 25/53] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:47 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:47.442328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:47.443616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:47.449938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.450867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.451860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:47.452674 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:47.474655 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.483550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.485289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.486624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d0cad6ef-bb8a-4692-9d19-39ad4866ad3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.181723 May 13 13:49:47.488133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 29/54] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:47 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:47.526900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:47.534119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-26d372e7-3088-492d-a402-677c3b043ef0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.098336 May 13 13:49:47.535129 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 26/55] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:47 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:48.152376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:48.153381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:48.162913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.163383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.164310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.164526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.312882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.321070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0a89594d-2c53-4f52-9220-376eb67b601d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.175695 May 13 13:49:48.321609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 30/56] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:48 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:48.397739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:48.398333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:48.405137 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.405585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.406384 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.406814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.505312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:48.505923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:48.511939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.512388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.513158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.513760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.547312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.555007 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-000e9296-8973-4db6-b67f-3a2d6a3cf494 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.161644 May 13 13:49:48.555582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 27/57] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:48 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:48.560059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:48.560639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:48.566634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.567077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.567831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:48.568276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:48.629163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.636743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8639670d-3920-4aa0-9d55-1093ec04eede tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.080058 May 13 13:49:48.637284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 28/58] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:48 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:48.641134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.649748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.651223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:48.652334 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9afaff7a-d5fb-4ace-bc41-0a692d5094d8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.151532 May 13 13:49:48.652888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 31/59] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:48 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:49.275216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-2abbc41a-4299-4d0c-a16c-08646dcc420d req-d8a06244-2ab2-46bc-9b3d-c997a47d0bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa256c0-8e95-448c-8c8b-f639d17d1ade", "tag": "edb51ec7-82e4-4dfb-b862-eb58ed42115b"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:49.285790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-2abbc41a-4299-4d0c-a16c-08646dcc420d req-d8a06244-2ab2-46bc-9b3d-c997a47d0bdc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.286367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-2abbc41a-4299-4d0c-a16c-08646dcc420d req-d8a06244-2ab2-46bc-9b3d-c997a47d0bdc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.299400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-2abbc41a-4299-4d0c-a16c-08646dcc420d req-d8a06244-2ab2-46bc-9b3d-c997a47d0bdc service nova] Creating event network-changed:edb51ec7-82e4-4dfb-b862-eb58ed42115b for instance efa256c0-8e95-448c-8c8b-f639d17d1ade on hv-cinder-79578 May 13 13:49:49.305073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-2abbc41a-4299-4d0c-a16c-08646dcc420d req-d8a06244-2ab2-46bc-9b3d-c997a47d0bdc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034583 May 13 13:49:49.305653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 29/60] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:49.338011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:49.338645 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:49.344790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.345238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.345993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.346465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.485187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.493576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7aa9f37c-0541-4088-87a2-fb05397f4264 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.159409 May 13 13:49:49.494178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 32/61] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:49 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:49.576613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:49.577718 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:49.589111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.589810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.591132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.591856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.653468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:49.654061 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:49.660957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.661410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.662219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.662653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.724562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.732057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ba327476-ff44-424f-9072-40ac55c3a874 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.082916 May 13 13:49:49.732661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 33/62] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:49 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:49.736994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:49.738312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:49.740617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.744193 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.744618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.745400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:49.745833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:49.749152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ded300cf-d8eb-4017-bbf3-4b2abed316c7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.179595 May 13 13:49:49.749804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 30/63] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:49 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:49.879374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.887218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.888731 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:49.889829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-166d4c12-a7c8-421a-9fec-51bce356cedc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.156301 May 13 13:49:49.890415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 34/64] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:49 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:50.517735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:50.519018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:50.529640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.530952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.531684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.532439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.665349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:50.673500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b1500f8b-e04d-478e-89af-dbb05626c6de tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.162292 May 13 13:49:50.674069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 31/65] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:50 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:50.751714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:50.752336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:50.761899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.762405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.763161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.763596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.767364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:50.768040 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:50.774645 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.775090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.775858 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.776287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.831716 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:50.839278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-720dbb2c-215e-44db-a2b3-9cb372b49969 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.093999 May 13 13:49:50.839850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 35/66] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:50 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:50.907981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:50.908702 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:50.909502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:50.916005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.916454 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.917232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ffb8e45c-56dc-49c8-8ea0-f7c8773f430c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.153516 May 13 13:49:50.917394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:50.917676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:50.918188 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 32/67] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:50 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:51.056573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:51.067765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:51.077176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:51.077176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4b7b858e-41fb-4751-bb04-0cd6ff309897 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.166217 May 13 13:49:51.077176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 36/68] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:50 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:51.693473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:51.694074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:51.700613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.701062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:51.701830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.702299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:51.837248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:51.845097 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc6f2a6e-ec4c-4c13-811a-d6231114f60b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.156640 May 13 13:49:51.845924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 33/69] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:51 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:51.856359 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:51.856960 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:51.863287 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.863723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:51.864474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.864895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:51.925308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:51.932949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2ba3f191-6ab5-4d24-95af-6689aa6d114b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.080580 May 13 13:49:51.933475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 37/70] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:51 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:51.934923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:51.935532 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:51.941895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.942378 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:51.943146 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:51.943647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.073731 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:52.083149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1f973e95-08c7-43a8-a2b6-487496b7c8da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.152082 May 13 13:49:52.088275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 34/71] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:51 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:52.089215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:52.089215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:52.094759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.095208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.095968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.096385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.228270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:52.236066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:52.237813 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:52.238939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b42a2e85-46c8-4d03-97c7-820d6798307c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.155501 May 13 13:49:52.239501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 38/72] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:52 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:52.863969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:52.864586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:52.871206 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.871699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.872601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.873155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.950317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:52.951246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:52.958072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.958543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:52.959351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:52.959860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:53.007722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.015511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a84a9faa-5baf-492c-8f23-3d71eb532b94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.155876 May 13 13:49:53.016068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 35/73] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:52 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:53.031489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.039255 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-909c3fbe-6739-4010-820a-beb37ae5ea8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.092926 May 13 13:49:53.039832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 39/74] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:52 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:53.100097 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:53.100635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:53.107009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:53.107462 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:53.108253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:53.108693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:53.258064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:53.259990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:53.263830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.272780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:53.273357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:53.274632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:53.275119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:53.280846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-205d0d23-f53f-4255-b3b5-fd3fa0ed87d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.183088 May 13 13:49:53.282294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 36/75] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:53 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:53.438309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.446970 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.448476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:53.450396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-deced647-8159-49ea-8087-3679119958a4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.197018 May 13 13:49:53.451257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 40/76] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:53 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:54.032738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:54.033984 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:54.040695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.041142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.041999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.042626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.059437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:54.060789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:54.070699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.072496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.073582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.075718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.233372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.243883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e7b30af8-1c9e-4113-8e48-b78438e87d26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1296 microversion: 2.1 time: 0.189521 May 13 13:49:54.244538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 41/77] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:54 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:54.298771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:54.300339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:54.307145 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.307566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.308514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.309341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.465249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.475389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fa644c4d-8d13-4fbc-a7a6-28e291348078 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.446424 May 13 13:49:54.476124 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 37/78] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:54 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:54.481516 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:54.482304 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:54.489633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.490116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.490901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:54.491333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:54.607539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.615348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b72335b4-043f-4c8c-af39-38ec4ace5984 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.320894 May 13 13:49:54.615923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 42/79] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:54 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:54.840253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.858110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.870704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:54.872844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-76e188af-7f2d-431d-a6ba-44b5da9e8f8a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.395563 May 13 13:49:54.874319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 38/80] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:54 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:55.262156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:55.262768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:55.273478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.274884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.275704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.276169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.460385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:55.483299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5203a39f-8205-4ed9-874d-ec24ff374e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.225749 May 13 13:49:55.494366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 43/81] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:55 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:55.497833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:55.498562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:55.505981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.506289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.507048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.507728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.632554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:55.633655 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:55.639757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.640482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.641860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.642414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.654391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:55.663603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d4840084-dbff-467e-abb8-83f7898d12d3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.175248 May 13 13:49:55.664900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 39/82] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:55 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:55.819150 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:55.827233 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d3421185-536d-457e-a0bc-303f93e66fbb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.198897 May 13 13:49:55.836775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 44/83] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:55 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:55.893241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:55.895254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:55.902690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.903358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:55.904458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:55.905077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.374628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:56.388800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:56.390521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:56.394760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0338f166-9c55-437b-82b8-246b846642cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.504000 May 13 13:49:56.395487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 40/84] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:55 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:56.511759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:56.513030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:56.519527 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.520213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.521324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.521889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.681110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:56.682441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:56.690365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.690831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.691615 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.692048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.693351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:56.702609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-39d0751c-555c-42fa-97b3-c326913df93f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.205485 May 13 13:49:56.703754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 45/85] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:56 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:56.853132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:56.853889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:56.863687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.864634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:56.865855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:56.866468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.027329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.035459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6ee6709c-8e2b-4dba-a6f1-4997f3efa548 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.358343 May 13 13:49:57.053259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 41/86] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:56 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:57.124629 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.133267 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-66b61de1-a216-4d44-94f3-aca23873b23d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.293116 May 13 13:49:57.137309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 46/87] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:56 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:57.264760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-aa236934-960a-4eb6-8786-bfa728cab712 req-8d77a550-2f10-4677-b93e-2d295bcdada6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fef620-abd7-40d5-a072-6af7a0a22ad0", "tag": "bb69988a-2d0c-4a82-9daa-b671976e609d"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:49:57.274913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-aa236934-960a-4eb6-8786-bfa728cab712 req-8d77a550-2f10-4677-b93e-2d295bcdada6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:57.275353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-aa236934-960a-4eb6-8786-bfa728cab712 req-8d77a550-2f10-4677-b93e-2d295bcdada6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.306024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-aa236934-960a-4eb6-8786-bfa728cab712 req-8d77a550-2f10-4677-b93e-2d295bcdada6 service nova] Creating event network-changed:bb69988a-2d0c-4a82-9daa-b671976e609d for instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 on hv-cinder-79578 May 13 13:49:57.318939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-aa236934-960a-4eb6-8786-bfa728cab712 req-8d77a550-2f10-4677-b93e-2d295bcdada6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058227 May 13 13:49:57.319974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 42/88] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:57.414140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.414751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:57.422818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:57.423310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.430870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:57.431546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.587173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.595943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.597536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.598674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-06682c0a-fc8d-46cc-a3f6-f97850c39442 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.189987 May 13 13:49:57.599230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 47/89] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:57.721421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.722630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:57.729126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:57.729587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.730510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:57.730932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:57.873689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:57.881059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5c5006d4-2780-4786-ac8f-613aa4abea97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.164201 May 13 13:49:57.881649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 43/90] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:58.059562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:58.060433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:58.067630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.068038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.069020 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.069438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.154208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:58.154810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:58.161139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.161583 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.163316 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.163760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.203075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:58.210993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-49c4d9b0-8233-4c06-82eb-fd9283cbf338 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.155560 May 13 13:49:58.220650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 48/91] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:58 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:58.303517 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:58.310924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dcc33fd9-e278-4a81-9361-2274b66af9a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.160502 May 13 13:49:58.311547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 44/92] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:58 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:58.616642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:58.617576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:58.624857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.625442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.626383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.626915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.846503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:58.855773 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:58.859526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:58.861346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-875951cd-2e09-4af8-b09e-e36c3eccc07d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.248922 May 13 13:49:58.862230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 49/93] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:58 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:58.899439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:58.900354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:58.908440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.908884 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:58.910425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:58.910754 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.228685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:59.230259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:59.237080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.237807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.238817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.239719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.243022 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:59.253229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b231111a-7fa3-413d-838d-06a8c83d3e15 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.358862 May 13 13:49:59.254925 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 45/94] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:58 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:59.327965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:59.329105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:59.335734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.336306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.337177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.337962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.579292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:59.587837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e20f825-f03e-49a7-b182-38cf50ac204f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.264494 May 13 13:49:59.588416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 46/95] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:59 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:59.617309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:49:59.626731 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-602fe74d-31e7-4432-8f9f-45f4e122e83d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.402514 May 13 13:49:59.628385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 50/96] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:49:59 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:59.880019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:59.880825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:49:59.908891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.911461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:49:59.912655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:49:59.914030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.162068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.172151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.173749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.175425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b337bab5-9d27-4fcc-b8d8-af3cca8477ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.299184 May 13 13:50:00.186927 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 47/97] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:49:59 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:00.271019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:00.271628 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:00.278245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.278693 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.279462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.279893 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.416157 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.423447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4b33a822-13c7-4f7d-a4dd-3221c20b924b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.156411 May 13 13:50:00.424011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 51/98] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:00 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:00.605630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:00.606477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:00.612809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.613303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.614312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.614820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.644956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:00.646317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:00.653976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.654841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.655799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:00.656532 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:00.787804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.795257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5f92e878-b870-4870-a5d9-4dcf255a64f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.193668 May 13 13:50:00.795831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 48/99] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:00 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:00.835276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:00.843458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-00aa5c7d-6b91-4655-bdef-77e09dd38c3a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.202841 May 13 13:50:00.844050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 52/100] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:00 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:01.193751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:01.194529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:01.200512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.201550 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.203287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.204223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.419845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:01.428855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:01.434367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:01.436263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c5965a20-8cd2-45da-924a-30970073673b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.246069 May 13 13:50:01.437092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 49/101] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:01 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:01.443306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:01.444228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:01.452149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.453074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.453896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.454435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.530830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-153a7396-ca99-435d-b73a-71b00cefa7c4 req-12cfbdf4-d041-4d8a-8e27-2f526882ca2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe8806f-ef13-4621-9dea-850cdab53624", "name": "network-vif-plugged", "status": "completed", "tag": "1463c1e5-8ddd-4a01-b534-d61cc17637a8"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:01.544701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-153a7396-ca99-435d-b73a-71b00cefa7c4 req-12cfbdf4-d041-4d8a-8e27-2f526882ca2e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.546295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-153a7396-ca99-435d-b73a-71b00cefa7c4 req-12cfbdf4-d041-4d8a-8e27-2f526882ca2e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.591299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-153a7396-ca99-435d-b73a-71b00cefa7c4 req-12cfbdf4-d041-4d8a-8e27-2f526882ca2e service nova] Creating event network-vif-plugged:1463c1e5-8ddd-4a01-b534-d61cc17637a8 for instance 5fe8806f-ef13-4621-9dea-850cdab53624 on hv-cinder-79578 May 13 13:50:01.598778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-153a7396-ca99-435d-b73a-71b00cefa7c4 req-12cfbdf4-d041-4d8a-8e27-2f526882ca2e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228503 May 13 13:50:01.603043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 53/102] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:01.649371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:01.656598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9d34f82a-f9c6-425d-bae3-9a7da28ba453 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.218189 May 13 13:50:01.657208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 50/103] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:01 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:01.812551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:01.813342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:01.820107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.820571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.821369 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.821861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.860871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:01.861360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:01.868808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.871056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.876521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:01.876521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:01.967942 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:01.975858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fa72b6d4-5aad-40c7-af22-25967cd60550 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.167595 May 13 13:50:01.976434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 54/104] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:01 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:02.017294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:02.025499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-91a0e107-90c8-449e-b2c4-bf7749899ae6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.168551 May 13 13:50:02.026092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 51/105] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:01 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:02.454802 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:02.455410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:02.461847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:02.462333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:02.463093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:02.463513 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:02.599013 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:02.607244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:02.608730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:02.609839 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c5184848-5efa-4a2a-a620-ab9f4fd5d990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.159077 May 13 13:50:02.610465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 55/106] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:02 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:02.675454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:02.676107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:02.683143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:02.683624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:02.684622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:02.685213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:02.860676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:02.869144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ef896300-2184-4386-800e-82ab330ff445 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.197937 May 13 13:50:02.869687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 52/107] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:02 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:02.992173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:02.993040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:02.999296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:02.999804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.000616 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.001107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.041823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:03.043162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:03.049563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.050089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.050840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.051269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.146652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:03.154519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cb605eec-0e45-47c9-8766-2ab2e9b09212 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.166306 May 13 13:50:03.155321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 56/108] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:02 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:03.191990 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:03.199155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2df741c6-dbe7-4ca4-bf92-16180f94e6ff tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.161351 May 13 13:50:03.199714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 53/109] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:03 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:03.629404 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:03.630388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:03.637158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.637612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.638413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.638849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.800812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:03.808918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:03.810436 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:03.811570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4fb12b26-8361-47dc-a302-395239dacc86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.186910 May 13 13:50:03.812124 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 57/110] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:03 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:03.885755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:03.886960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:03.893182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.894113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:03.894883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:03.895311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.025501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:04.032879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7eafd275-649c-45dd-b906-d4a7601a6ead tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.151043 May 13 13:50:04.033437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 54/111] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:03 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:04.172749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:04.173316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:04.180852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.181312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.182084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.182544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.216437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:04.217134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:04.223588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.224101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.224943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.225456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.323587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:04.331164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-48ccbf9e-dfd1-4e6f-9338-a010a0439dc3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.162529 May 13 13:50:04.331729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 58/112] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:04 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:04.375673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:04.383238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4baaa523-4fe5-4f52-96c4-331d3733c6cd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.170927 May 13 13:50:04.383806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 55/113] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:04 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:04.833595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:04.834338 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:04.850704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.851993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:04.852945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:04.853674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.005344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.013161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.014685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.015796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ac498f5e-a1bd-44a2-b94e-8634c90f9337 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.186175 May 13 13:50:05.016370 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 59/114] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:04 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:05.050181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:05.050784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:05.056829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.057337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.058028 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.058476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.187178 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.194976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-04375429-779d-4225-b0f2-6118e27ac617 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.149327 May 13 13:50:05.195513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 56/115] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:05 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:05.349331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:05.349874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:05.356608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.357259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.358173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.358762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.401119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:05.401901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:05.408249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.408788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.409813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:05.410508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:05.493699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.502080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-170f12aa-5484-426c-887a-8d390e70b08a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.157650 May 13 13:50:05.503176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 60/116] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:05 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:05.548822 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:05.557169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-196d4010-9a5d-4ee0-88f2-3c7893c2953e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.160557 May 13 13:50:05.557747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 57/117] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:05 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:06.035505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:06.036465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:06.043577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.044478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.045935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.046882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.188321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.196741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.198426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.199694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-305328bd-4bc0-4359-9483-46b5689e26ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.168918 May 13 13:50:06.200416 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 61/118] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:06 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:06.211889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:06.212504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:06.218509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.218951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.219740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.220166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.402283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.411038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f1abd434-cff1-4099-9366-63398c818b58 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.202961 May 13 13:50:06.411756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 58/119] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:06 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:06.519098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:06.519729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:06.526492 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.527059 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.527915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.528429 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.573952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:06.574840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:06.581592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.582282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.583200 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:06.583773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:06.671461 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.679681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4005a48c-d706-416f-bd6c-e6fa71b81d98 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.164521 May 13 13:50:06.680460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 62/120] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:06 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:06.727633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:06.735048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5edad569-8d95-41e0-bf1f-7bce18fa9bfb tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.164853 May 13 13:50:06.735613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 59/121] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:06 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:07.219234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:07.219958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:07.226025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.226555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.227513 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.227998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.364224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.372417 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.373952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.375097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-04f8a43c-f76e-40ac-9eb2-3618d8100b4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.160212 May 13 13:50:07.375658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 63/122] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:07 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:50:07.428670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:07.429244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:07.435715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.436171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.436967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.437401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.572601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.580512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3f1c780e-c3d1-4123-810e-a39a69506fdd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.156212 May 13 13:50:07.581095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 60/123] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:07 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:07.700953 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:07.701941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:07.710696 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.711182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.712189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.712676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.752070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:07.752759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:07.759338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.759793 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.760564 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:07.761003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:07.846262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.854528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-65f27abb-0fc2-476c-b474-0a412cb1e20b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.159682 May 13 13:50:07.855121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 64/124] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:07 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:07.889596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:07.902021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-994fe49f-6b80-464e-bec4-5b185836b74b tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.153530 May 13 13:50:07.902846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 61/125] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:07 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:08.397195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:08.397896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:08.404908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.405349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.406201 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.406648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.539895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:08.548344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:08.549921 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:08.551040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b2c4b931-2e83-40d8-b93d-9a2a8270cfb0 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.160758 May 13 13:50:08.551598 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 65/126] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:08 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:08.597981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:08.598603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:08.604983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.605427 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.606236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.606641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.749845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:08.758663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d36632ae-4cc0-4095-b382-abc6abf2c1f1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.164675 May 13 13:50:08.759229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 62/127] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:08 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:08.875315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:08.876306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:08.883592 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.884038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.884833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.885256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.921920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:08.922594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:08.929284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.929722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:08.930518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:08.930940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:09.021431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.029342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-60348d3f-d8f6-44f5-8859-f10543e8beff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.160433 May 13 13:50:09.029917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 66/128] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:08 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:09.069464 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.077520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4ce1a4d2-c3a8-4d13-a7d8-b5268920a8b3 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.159297 May 13 13:50:09.078123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 63/129] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:08 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:09.573253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:09.574100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:09.584301 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:09.585043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:09.586355 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:09.587097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:09.723999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.731844 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.733341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.734472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9fdb6c66-7eef-423d-809b-4f6c05e9d961 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.167729 May 13 13:50:09.735071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 67/130] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:09 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:09.775993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:09.776595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:09.783040 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:09.783486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:09.784606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:09.784950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:09.914536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:09.922069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eeaa73cf-4838-4f7e-911a-406a5b66d47d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.150272 May 13 13:50:09.922671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 64/131] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:09 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:10.047151 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:10.047701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:10.054188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.054629 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.055381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.055811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.098861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:10.099654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:10.105901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.106374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.107140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.107547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.192281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:10.202290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-02cf25ab-7505-494e-a675-d12a2f76cc7f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.158427 May 13 13:50:10.203205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 68/132] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:10 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:10.465798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:10.474688 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c639e301-cfc7-47a8-ae87-ae57edec1dce tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.381697 May 13 13:50:10.475592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 65/133] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:10 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:10.755203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:10.756014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:10.763409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.763559 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.764717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.765312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.917908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:10.928801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:10.930965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:10.932048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ffa58bf4-c4d0-4ede-8265-56c8c10662fb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.182966 May 13 13:50:10.932607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 69/134] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:10 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:10.940075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:10.940881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:10.947389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.947818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:10.948583 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:10.949009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.100399 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:11.108836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eddcc204-e60a-4ae4-a435-f55a4679328f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.172470 May 13 13:50:11.111566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 66/135] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:10 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:11.221836 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:11.222588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:11.229171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.229612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.230409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.230835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.362188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:11.374028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-10144078-bd86-491c-979b-0c0ce71729ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.156014 May 13 13:50:11.374622 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 70/136] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:11 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:11.495115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:11.496106 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:11.505909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.506575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.507852 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.508407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.645186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:11.656757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eb2f896c-3f03-4ab3-a9a6-eaa430b258db tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.167849 May 13 13:50:11.657390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 67/137] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:11 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:11.954095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:11.954905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:11.962057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.962520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:11.963280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:11.963709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.106017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.114725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.115934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.117050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b0e86ecc-044c-467d-a775-8fcfabedc968 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.169022 May 13 13:50:12.117595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 71/138] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:11 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:12.127052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:12.129396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:12.135342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.135808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.136574 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.136991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.267748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.275549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f76b94dd-7f36-4d7b-bb68-e75db6e7541b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.153165 May 13 13:50:12.276138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 68/139] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:12 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:12.392053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:12.392800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:12.400102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.400706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.401633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.402353 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.543221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.552544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-565624df-1390-401f-b488-639cfe1f9e80 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.165036 May 13 13:50:12.553163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 72/140] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:12 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:12.675538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:12.676357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:12.686110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.686800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.687913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:12.688545 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:12.830898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:12.838435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7bf60846-92b2-4ef2-b274-e4feddd950a0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.168933 May 13 13:50:12.838988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 69/141] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:12 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:13.139853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:13.140718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:13.151467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.152199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.153891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.154658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.292596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:13.293187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:13.293282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:13.299232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.299705 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.300464 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.300888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.302303 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:13.303840 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:13.304954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8edc0be0-6462-4207-bae4-8d6a8fa6d76a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.171822 May 13 13:50:13.305513 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 73/142] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:13 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:13.430160 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:13.437794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f5e9b0db-4a3d-4b9b-ade3-000840fbcd7d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.149075 May 13 13:50:13.438412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 70/143] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:13 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:13.570178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:13.570864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:13.577039 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.577468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.578380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.578833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.708064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:13.715549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bed145af-d4a9-4102-aa1c-5311eb17a356 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.149252 May 13 13:50:13.716117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 74/144] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:13 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:13.859876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:13.860876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:13.871539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.872339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:13.873596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:13.874398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.016164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.024747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d8852267-34be-4971-b9d6-6a872a6aa779 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.170956 May 13 13:50:14.025312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 71/145] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:13 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:14.323474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:14.324080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:14.332092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.332546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.333316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.333748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.454337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:14.454971 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:14.461412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.461856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.462665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.463095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.463526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.471918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.473627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.474756 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bb09d6bb-9cbd-4baf-a068-1a256dbba598 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.155672 May 13 13:50:14.475335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 75/146] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:14 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:14.597745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.605802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc8b7bce-d269-41c4-9bd4-e7c88f4cf2d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.155298 May 13 13:50:14.606529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 72/147] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:14 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:14.741652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:14.741652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:14.741652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.741652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.742810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:14.742810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:14.871784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:14.879275 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b1b25526-d5fe-4f7f-9fc4-a1d2eb3e7c49 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.150441 May 13 13:50:14.879896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 76/148] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:14 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:15.044152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:15.044869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:15.052293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.052738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.053506 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.053940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.181628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:15.192592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cb557e49-e1a6-4acf-99fc-3f8e806237c5 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.153832 May 13 13:50:15.193421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 73/149] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:15 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:15.493396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:15.494027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:15.502074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.502074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.502769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.503349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.622727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:15.623328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:15.630284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.630733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.631480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.631946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.638547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:15.647101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:15.648695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:15.650232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d06bc144-a55d-449e-94b1-b87c3bb25526 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.160914 May 13 13:50:15.651079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 77/150] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:15 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:15.768257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:15.777295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a2da8389-ee9b-4dbb-816d-a0fab5509fa5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.158491 May 13 13:50:15.777872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 74/151] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:15 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:15.898116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:15.898736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:15.905437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.905985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:15.906878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:15.907385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.214916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:16.215844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:16.221702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.222267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.223258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.223682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.228581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.236162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c86c1a10-3cd6-4b45-bf7d-3887191c0fbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.342325 May 13 13:50:16.236741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 78/152] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:15 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:16.371598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.383200 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ef69fbc9-63c0-438a-9a3c-967596073fac tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.168324 May 13 13:50:16.390319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 75/153] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:16 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:16.671977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:16.672602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:16.680106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.680548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.681305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.681746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.794529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:16.795139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:16.802210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.802664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.803444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:16.803883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:16.818890 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.827682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.829335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.830653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1ecfcbbe-206c-482c-b152-00389788f214 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.164903 May 13 13:50:16.833875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 79/154] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:16 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:16.936666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:16.946278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0da3edea-2c18-4e48-b46a-cff787c5447d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.155449 May 13 13:50:16.946862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 76/155] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:16 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:17.255443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:17.256150 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:17.264146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.264700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.265642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.266218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.397484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:17.398270 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:17.404888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.405442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.406380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.407033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:17.407273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.414683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-570f55ec-9dea-4cbf-b298-cd891aa73635 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.164155 May 13 13:50:17.415291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 80/156] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:17 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:17.541052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:17.548558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-70a73012-7ada-4ae2-b62d-01b749b05f25 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.155401 May 13 13:50:17.549121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 77/157] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:17 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:17.853476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:17.854163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:17.862350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.862912 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.863870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.864395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.966772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:17.967374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:17.973504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.974105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.974866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:17.975301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:17.995677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.003838 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.005526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.006661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-dcd74596-883e-4546-bdc8-ba72a04bdf8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.158332 May 13 13:50:18.007235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 81/158] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:17 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:18.104381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.113948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-084e8585-3b54-4718-91a9-1c9668d97614 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.151300 May 13 13:50:18.114559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 78/159] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:17 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:18.436895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:18.437411 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:18.444617 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:18.445254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:18.446235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:18.446771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:18.564929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:18.565543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:18.579484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:18.579938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:18.580720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:18.581149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:18.611534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.620225 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2118bbed-c02d-48fc-b21b-7f436e77e241 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.187085 May 13 13:50:18.638335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 82/160] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:18 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:18.745198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-4c788308-ce8a-4916-be02-ad7a7961f78c req-da92da36-71a2-4727-bb5a-5a5e70f07490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa256c0-8e95-448c-8c8b-f639d17d1ade", "name": "network-vif-plugged", "status": "completed", "tag": "edb51ec7-82e4-4dfb-b862-eb58ed42115b"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:18.755367 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4c788308-ce8a-4916-be02-ad7a7961f78c req-da92da36-71a2-4727-bb5a-5a5e70f07490 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:18.755367 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4c788308-ce8a-4916-be02-ad7a7961f78c req-da92da36-71a2-4727-bb5a-5a5e70f07490 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:18.776184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-4c788308-ce8a-4916-be02-ad7a7961f78c req-da92da36-71a2-4727-bb5a-5a5e70f07490 service nova] Creating event network-vif-plugged:edb51ec7-82e4-4dfb-b862-eb58ed42115b for instance efa256c0-8e95-448c-8c8b-f639d17d1ade on hv-cinder-79578 May 13 13:50:18.782657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-4c788308-ce8a-4916-be02-ad7a7961f78c req-da92da36-71a2-4727-bb5a-5a5e70f07490 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049141 May 13 13:50:18.783504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 83/161] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:18.784385 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:18.792349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-45aa0c03-7dda-4f38-ac7b-2a287af28ae8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.231452 May 13 13:50:18.792905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 79/162] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:18 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:19.029754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:19.030866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:19.041033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.041713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.042938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.043604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.131229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:19.131836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:19.137931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.138393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.139853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.140274 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.182887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.190715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.192614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.193764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3c91a875-6709-4f58-8225-58ccb422e76c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.171074 May 13 13:50:19.194330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 84/163] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:19 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:19.348615 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.360216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6986f7a5-8e21-4c81-9dce-90df81cfbf33 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.232336 May 13 13:50:19.361621 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 80/164] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:19 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:19.642446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-20068292", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "networks": [{"uuid": "021f0711-6445-4a50-99e4-3f54d3dcef88"}]}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:19.647418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:19.648255 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:19.654766 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.655319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.656176 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.656699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.710524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] validate_networks() for [('021f0711-6445-4a50-99e4-3f54d3dcef88', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:50:19.795854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.804303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-29b5084a-7039-4328-933a-b408ad88c48e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.161475 May 13 13:50:19.804874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 81/165] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:19 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:19.809347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:19.809931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:19.815861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.816309 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.817069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:19.817492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:19.944440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:19.952095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-69366e2a-d452-4d93-a74d-f05e91b2d155 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.146226 May 13 13:50:19.952748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 82/166] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:19 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:20.068352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:50:20.068790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:50:20.069240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:50:20.069617 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:50:20.070060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:50:20.079861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.080305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.081102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.081648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.098018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Getting quotas for project 79a1d6b4748a4489b8364d566debd6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:50:20.102675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Getting quotas for user 4f9f35a812544a4584deb7276166d0d3 and project 79a1d6b4748a4489b8364d566debd6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:50:20.114545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:50:20.116777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:50:20.164332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-36592a24-140d-4a3e-ae1f-8695c0c69ba4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526390 May 13 13:50:20.164876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 85/167] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:50:20.174787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5f1d4263-6556-44b0-b199-7ef6d981c091 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:20.175503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5f1d4263-6556-44b0-b199-7ef6d981c091 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:20.212256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:20.212843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:20.218936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.219366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.220130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.220562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.232644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f1d4263-6556-44b0-b199-7ef6d981c091 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.240855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5f1d4263-6556-44b0-b199-7ef6d981c091 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1217 microversion: 2.1 time: 0.069832 May 13 13:50:20.241762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 83/168] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:20 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:20.362514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.371051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.372548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.373932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7ab4c1f9-ee9b-49b9-b900-b71eeaf36eb4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.165942 May 13 13:50:20.374943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 86/169] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:20 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:50:20.378086 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:20.378932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:20.384887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.385332 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.386120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.386590 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.518711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.526574 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-468a0240-1baf-4893-b2a9-505ad83a5331 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.152401 May 13 13:50:20.527135 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 84/170] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:20 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:20.821511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:20.822782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:20.828888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.829340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.830163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.830599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.965577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:20.969741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:20.970434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:20.973741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-61c4294b-b9b3-4465-9f70-c5cbbfbed8f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.156080 May 13 13:50:20.974377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 87/171] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:20 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:20.976530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.976966 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:20.977719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:20.978174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.107353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.114976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4c0f057f-4591-43bb-95e0-87033a6a3dc0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.149052 May 13 13:50:21.115515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 85/172] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:20 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:21.262893 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:21.263889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:21.273088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.273535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.274667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.275099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.340760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.348405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-120edc2d-76e1-4fb4-a026-0c3216620443 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1221 microversion: 2.1 time: 0.092270 May 13 13:50:21.348974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 88/173] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:21 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:21.396115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:21.396712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:21.407042 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.407640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.408761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.409311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.543933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:21.544456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:21.550567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.551208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.552019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.552456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:21.559581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.568524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.570029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.571195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6753e0fe-4661-4025-a08a-642b7c2bee87 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.181329 May 13 13:50:21.571704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 86/174] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:21 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:21.689937 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:21.702292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-877ac490-8fd0-45bf-9910-0ca45b193c28 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.162056 May 13 13:50:21.703113 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 89/175] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:21 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:21.992022 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:21.992631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:21.998848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:21.999298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.000065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.000497 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.132085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.136663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:22.137266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:22.139979 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9abebbbe-0be5-41d4-b900-4985a879cfd0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.152911 May 13 13:50:22.140546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 87/176] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:21 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:22.143351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.143791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.144549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.144992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.279816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.287680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-90913e9f-d86d-4d87-9725-15d72b2a82e9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.154745 May 13 13:50:22.288249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 90/177] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:22 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:22.368949 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:22.369819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:22.379898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.380345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.381109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.381540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.450380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.458260 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc5e785c-e08e-47d6-9696-51c04f2b2b26 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1221 microversion: 2.1 time: 0.095918 May 13 13:50:22.458833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 88/178] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:22 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:22.592473 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:22.593253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:22.603096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.603697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.604844 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.605407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.720874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:22.721482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:22.727749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.728198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.728961 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:22.729391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:22.740000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.748515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.750004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.751174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-18806640-3e0f-4575-975a-39a566b53a66 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.165025 May 13 13:50:22.751736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 91/179] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:22 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:22.860836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:22.869205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-13a9b08a-89d3-4e4c-a1b6-a2cffca577d5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.152234 May 13 13:50:22.869770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 89/180] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:22 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:23.161138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:23.161838 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:23.169300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.169819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.170755 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.171257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.309720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.310032 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:23.310653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:23.316643 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.317030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.317690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-24346d82-ecb1-4bb8-b662-2c513920e9bf tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.162433 May 13 13:50:23.318017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 92/181] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:23 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:23.318769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.319256 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.450976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.459365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5cb37bdb-23cc-4428-824c-a0e0b2fafd5a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.153196 May 13 13:50:23.459940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 90/182] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:23 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:23.478088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:23.478969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:23.488840 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.489292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.490086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.490520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.555256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.566438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-be46e5da-b9e2-47ae-a99e-cd32585f803f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1221 microversion: 2.1 time: 0.094208 May 13 13:50:23.567130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 93/183] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:23 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:23.770380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:23.771100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:23.778964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.779482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.780401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.780898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.886083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:23.886721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:23.893119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.893567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.894402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:23.894834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:23.917538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.926509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.928210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:23.929551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-957e58d0-76f6-41a9-a3bd-2308ba699104 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.164010 May 13 13:50:23.940664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 91/184] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:23 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:24.025831 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:24.033237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6cdcc4eb-3046-4b07-8a1c-e05a16b09527 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.151048 May 13 13:50:24.033771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 94/185] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:23 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:24.338578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:24.339493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:24.346318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.346763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.347573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.347961 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.480307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:24.480938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:24.481288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:24.486933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.487502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.488333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.488567 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7456ee0e-e605-41f1-b3a3-5e65d87f2f02 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.157265 May 13 13:50:24.488983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.489200 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 92/186] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:24 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:24.583704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:24.584317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:24.590521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.590901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.591676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.592285 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.621395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:24.629362 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f0bb67d1-96d5-4f1a-90d2-70ba93febf30 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.153133 May 13 13:50:24.629938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 95/187] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:24 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:24.654891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:24.664058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d831aac1-4861-4fe5-9542-ae834baa29fa tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1221 microversion: 2.1 time: 0.084297 May 13 13:50:24.664628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 93/188] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:24 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:24.947759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:24.948555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:24.955683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.956144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:24.956946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:24.957518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.052572 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:25.053159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:25.061003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.061443 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.062268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.062696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.144985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.159970 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.161919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.163317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a6733b53-d13d-4cbe-a61c-3bd092091f72 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.219703 May 13 13:50:25.173663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 96/189] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:24 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:25.245201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.253206 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ccdc4803-9862-454d-ac2f-01abd10f7099 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.204746 May 13 13:50:25.253908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 94/190] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:25 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:25.506364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:25.507090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:25.512865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.513275 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.514072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.514668 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.647833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:25.648293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:25.652740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.654878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.655323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.656090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.656516 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.660964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-50b5e373-7e9e-4a62-b499-a04b1af40727 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.158839 May 13 13:50:25.661535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 97/191] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:25 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:25.680675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:25.681491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:25.687973 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.688411 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.689171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:25.689590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:25.753459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.761439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c18c48bc-08ef-4df6-a19e-65259d0ae7ee tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1221 microversion: 2.1 time: 0.084457 May 13 13:50:25.762329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 98/192] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:25 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:25.797610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:25.805370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5efdc1e8-22a5-47e4-8655-599ba292ec2d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.162652 May 13 13:50:25.805938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 95/193] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:25 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:26.181197 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:26.181939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:26.188346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.188962 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.189714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.190425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.273138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:26.274805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:26.281835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.282445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.289848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.290547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.359850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:26.368165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:26.369634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:26.370769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c13eb9ed-c0b3-4e31-8cdf-826dae85261a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.193846 May 13 13:50:26.373161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 99/194] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:26 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:26.387953 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-09d69be5-1981-49c0-bc38-e2bb25a38501 req-4a2943a5-1b44-4d67-8b17-7ca7197c368d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "name": "network-vif-plugged", "status": "completed", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:26.404187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-09d69be5-1981-49c0-bc38-e2bb25a38501 req-4a2943a5-1b44-4d67-8b17-7ca7197c368d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.404504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-09d69be5-1981-49c0-bc38-e2bb25a38501 req-4a2943a5-1b44-4d67-8b17-7ca7197c368d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.437545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-09d69be5-1981-49c0-bc38-e2bb25a38501 req-4a2943a5-1b44-4d67-8b17-7ca7197c368d service nova] Creating event network-vif-plugged:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:50:26.447440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-09d69be5-1981-49c0-bc38-e2bb25a38501 req-4a2943a5-1b44-4d67-8b17-7ca7197c368d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062923 May 13 13:50:26.448474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 100/195] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:26.511092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:26.519514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-40b56b42-fd9b-4342-bb2b-bf0ad6a2d8a3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.252107 May 13 13:50:26.529359 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 96/196] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:26 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:26.684654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:26.685312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:26.703449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.703908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.708329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.710323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.779198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:26.780027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:26.792196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.792641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.797302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.797723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.956922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:26.975272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cfba6323-47eb-4082-9d0f-0db48b9e7e84 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1213 microversion: 2.1 time: 0.199507 May 13 13:50:26.976729 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 97/197] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:26 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1213 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:26.983011 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:26.983825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:26.993774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.994526 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:26.995667 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:26.996272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:27.026556 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.034344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d13ad5cd-9883-430b-8ec7-66172b2efbe1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.354670 May 13 13:50:27.035402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 101/198] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:26 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:27.134315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.141688 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b6ebfdb9-4c69-4899-a563-60ea08301659 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.162841 May 13 13:50:27.142294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 98/199] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:26 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:27.391069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:27.391795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:27.399965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:27.400507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:27.401318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:27.401857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:27.537407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:27.538020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:27.538800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.544404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:27.545068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:27.545841 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:27.546297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:27.546795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.548287 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.549623 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b516b79d-3cf9-4ca8-a0ba-d65ab3ff35f6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.162870 May 13 13:50:27.550193 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 102/200] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:27 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:27.678797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:27.686253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b4e7cd6c-e4f1-48bf-b4ef-98ff8b492505 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.153132 May 13 13:50:27.686817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 99/201] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:27 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:27.993094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:27.993611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:27.999846 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.000295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.001047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.001482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.051185 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:28.051922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:28.058217 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.058663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.059428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.060021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.071656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.079087 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b351f532-1d11-4a2b-bc1c-7fc91b72747c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.089973 May 13 13:50:28.079645 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 103/202] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:27 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:28.159273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:28.159863 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:28.166866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.167534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.168450 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.169017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.190763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.198424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-630f0ea6-5f8b-467e-bd0e-ff82a46f928b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.150973 May 13 13:50:28.199231 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 100/203] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:28 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:28.300745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.308362 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c298bc24-2b11-4431-b618-21c5a42b4774 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.152873 May 13 13:50:28.309068 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 104/204] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:28 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:28.568071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:28.568673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:28.574873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.575313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.576073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.576498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.703277 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:28.703423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.703863 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:28.710607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.712784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.713191 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.713980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:28.714451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:28.714672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.715985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e045eef4-744b-4070-9e89-3b2eb450f0f9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.152024 May 13 13:50:28.716687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 101/205] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:28 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:28.847563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:28.854952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-10f6f3a6-9778-495c-9cd1-3462de6071ac tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.155642 May 13 13:50:28.855526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 105/206] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:28 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:29.096179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:29.096865 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:29.103276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.103790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.104622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.105130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.183207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.191356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc4145f6-25e3-47a7-a58a-331dcddf8b72 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.099090 May 13 13:50:29.192467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 102/207] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:29 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:29.217507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:29.218133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:29.227416 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.228140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.229511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.230315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.330400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:29.331461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:29.339030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.339667 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.340669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.341374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.395294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.403781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0d9d73b0-44e3-41ac-9594-451a8bebc97e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.192008 May 13 13:50:29.413710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 106/208] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:29 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:29.486863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.496001 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-899a0785-a289-45c4-8506-377ff4c3fed9 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.173924 May 13 13:50:29.496886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 103/209] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:29 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:29.742757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:29.743642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:29.755852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.756377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.757308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.757806 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.872122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:29.872756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:29.878797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.879711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.880720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:29.881294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:29.900542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.910144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.912353 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:29.913500 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e570d36d-b878-4c77-96b0-14cba4826a32 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.182913 May 13 13:50:29.914147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 107/210] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:29 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:50:30.022887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:30.031655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4dd99ce5-3bcb-4d4d-9ec1-fa346ca79534 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.163479 May 13 13:50:30.032215 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 104/211] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:29 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:30.207950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:30.208634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:30.214904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.215363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.216123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.216555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.279464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:30.289168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-67460ed1-cd61-4318-8a68-71b02e174bef tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.085274 May 13 13:50:30.289750 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 108/212] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:30 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:30.420864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:30.421449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:30.428926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.429374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.430319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.430756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.512614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:30.514034 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:30.520002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.520451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.521203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.521630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.561018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:30.568440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-53b36e5a-a391-4d40-92d0-4905bf992ab9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.151342 May 13 13:50:30.569009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 105/213] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:30 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:30.653495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:30.661100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-16b139b1-aad3-4a5b-bc88-9c5bd7d92655 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.152274 May 13 13:50:30.661662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 109/214] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:30 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:30.932083 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:30.932711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:30.938976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.939421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:30.940172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:30.940600 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.054475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:31.056340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:31.077484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.086689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.087700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.089273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.186839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.197501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.200911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.202067 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-15faae11-7433-4f9d-b5ff-967b38625c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.273955 May 13 13:50:31.202623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 106/215] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:30 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:31.306308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:31.307104 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:31.316238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.317019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.318117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.318694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.361247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.368707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-20f0804e-0ae2-4920-9063-08bcd9f17c9f tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.323676 May 13 13:50:31.369509 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 110/216] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:31 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:31.391695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.399654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a183f34-3cc2-4de7-8664-6f355c0fd3f3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.096781 May 13 13:50:31.400230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 107/217] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:31 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:31.585252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:31.586582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:31.594235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.594235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.594235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.594235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.678008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:31.678757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:31.684757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.685204 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.686034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:31.686518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:31.736495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.746864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a5ef23dd-f52c-4236-a8f4-61c635398c3b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.165742 May 13 13:50:31.747523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 111/218] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:31 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:31.828553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:31.836078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c43c163b-6464-44d3-92c0-c875b2bddd6c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.161968 May 13 13:50:31.837198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 108/219] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:31 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:32.222029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:32.222972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:32.232422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.233096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.234343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.235038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.378624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.385981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:32.386648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:32.387418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.388983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.390224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2268b1b6-847b-4740-986d-696514965b21 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.173918 May 13 13:50:32.390769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 112/220] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:32 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:32.392764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.393191 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.393944 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.394410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.416950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:32.417701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:32.424164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.424596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.425363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.425789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.486822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.494759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e850ca74-28b7-4618-bf9c-e270b421f4d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.082170 May 13 13:50:32.495639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 113/221] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:32 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:32.526650 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.533980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-24188f86-c7f1-4d7b-aca5-28eae8b55184 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.151854 May 13 13:50:32.534592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 109/222] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:32 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:32.764878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:32.765484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:32.772254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.772701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.773474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.773906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.853511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:32.854131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:32.861869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.862533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.863305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:32.863872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:32.920791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:32.928318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e48ff9bb-33c6-477e-84c5-01bae5b87763 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.167324 May 13 13:50:32.928882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 114/223] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:32 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:33.021338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.028907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c234d48e-98b9-4d3c-a87e-f667e97cbef6 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.179850 May 13 13:50:33.029470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 110/224] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:32 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:33.408908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:33.409638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:33.416075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.416591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.417396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.417830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.512337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:33.513310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:33.520481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.521105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.521951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.522490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.564224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.574454 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.575993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.577296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9ad1d8de-ccb1-48a0-b549-3ec73734bc38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.172459 May 13 13:50:33.577847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 115/225] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:33 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:33.582835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:33.583826 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:33.590842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.591447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.592237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.592658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.593333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.602417 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f8ea4902-8970-4b42-b10f-a5cadb174f7f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.094152 May 13 13:50:33.603344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 111/226] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:33 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:33.730242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:33.738199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-07322ffb-677b-45f1-8879-e0813e5c608b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.159157 May 13 13:50:33.738894 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 116/227] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:33 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:33.948170 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:33.948798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:33.958223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.958665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:33.959449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:33.959885 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.047173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:34.047838 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:34.054550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.055005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.055791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.056223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.099683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.107581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f2f1ba25-9d8c-4f59-893a-c6adf0fe02e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.166202 May 13 13:50:34.108143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 112/228] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:33 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:34.185887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.195485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c188737f-c8bf-4a4a-b89a-1da4a5b7c887 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.152737 May 13 13:50:34.196054 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 117/229] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:34 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:34.595128 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:34.595723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:34.603535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.604003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.605835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.607277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.622524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:34.623092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:34.638231 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.638683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.639457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.642220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.717720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.726447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-73f5199d-c12f-4a1c-969e-ee99efbd0cd1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.109293 May 13 13:50:34.737608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 118/230] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:34 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:34.759456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:34.760332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:34.780309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.780829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.782075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.783651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.843289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.853598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.855366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:34.856695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-61f529cf-8813-489d-808c-0af17adb460f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.265245 May 13 13:50:34.858187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 113/231] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:34 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:34.863335 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-bdcfdea9-26d2-439a-84d8-af0df48ecba2 req-edf100bd-63bf-427d-b7cf-e4527b52ce5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361ca01b-bda3-4060-a318-72a052700b32", "name": "network-vif-plugged", "status": "completed", "tag": "0c30fb69-0384-45e4-b5b2-d0ee5152cea8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:34.878680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-bdcfdea9-26d2-439a-84d8-af0df48ecba2 req-edf100bd-63bf-427d-b7cf-e4527b52ce5d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:34.879140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-bdcfdea9-26d2-439a-84d8-af0df48ecba2 req-edf100bd-63bf-427d-b7cf-e4527b52ce5d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:34.901640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-bdcfdea9-26d2-439a-84d8-af0df48ecba2 req-edf100bd-63bf-427d-b7cf-e4527b52ce5d service nova] Creating event network-vif-plugged:0c30fb69-0384-45e4-b5b2-d0ee5152cea8 for instance 361ca01b-bda3-4060-a318-72a052700b32 on hv-cinder-79578 May 13 13:50:34.907172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-bdcfdea9-26d2-439a-84d8-af0df48ecba2 req-edf100bd-63bf-427d-b7cf-e4527b52ce5d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047505 May 13 13:50:34.907784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 114/232] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:34.998470 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:35.006224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b9117f7c-22b9-4c4d-852f-9a9b947e22fa tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.253239 May 13 13:50:35.006807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 119/233] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:34 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:35.124883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:35.125575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:35.132394 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.132833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.133603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.134254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.215825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:35.216549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:35.225627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.226204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.227223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.227757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.292519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:35.305986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-41754935-e020-4811-bd3a-76dc95af3528 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.185144 May 13 13:50:35.306728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 115/234] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:35 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:35.451333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:35.462357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4a687de3-6620-422b-bda4-07926945e20f tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.251921 May 13 13:50:35.472060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 120/235] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:35 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:35.745810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:35.746454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:35.753686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.754222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.755177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.755638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.840232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:35.851619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6e48b89d-eb02-47e3-a6ac-1ad9ab278167 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1269 microversion: 2.1 time: 0.110660 May 13 13:50:35.864691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 116/236] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:35 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1269 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:35.876932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:35.878799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:35.888576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.889487 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:35.891106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:35.891574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.023169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:36.023773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:36.030408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.031039 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.031881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.032596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.096409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.113218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.114892 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.115999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-98d31f7d-dee2-4516-99b1-7830eda59f4f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.244781 May 13 13:50:36.117055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 121/237] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:35 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:36.232485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.240763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-57e0674a-b6f3-45b1-b7d8-6c9635910c89 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.221460 May 13 13:50:36.241334 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 117/238] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:36 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:36.323856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:36.324461 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:36.330388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.331045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.331810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.332426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.479504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:36.480266 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:36.487167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.488075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.489717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.490391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.491890 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.500719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-33e7dd91-4a2c-4e71-a677-c7f8770eedf0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.181640 May 13 13:50:36.509824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 122/239] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:36 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:36.643669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.651872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b84432fa-bb71-4b98-963e-5eaa55137022 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.176590 May 13 13:50:36.652612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 118/240] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:36 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:36.872589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:36.873364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:36.883067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.884099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.885008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.885437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:36.955688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:36.966859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f1c747c3-50e1-4e66-9ddf-6aabc53ff2a6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1277 microversion: 2.1 time: 0.099265 May 13 13:50:36.969079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 123/241] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:36 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:36.978280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-14eb09bf-73c4-4b02-a5dc-4e7107e791fc req-3b93c5c7-a8f6-4f05-96ad-39737c289827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fef620-abd7-40d5-a072-6af7a0a22ad0", "name": "network-vif-plugged", "status": "completed", "tag": "bb69988a-2d0c-4a82-9daa-b671976e609d"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:36.992522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-14eb09bf-73c4-4b02-a5dc-4e7107e791fc req-3b93c5c7-a8f6-4f05-96ad-39737c289827 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:36.994520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-14eb09bf-73c4-4b02-a5dc-4e7107e791fc req-3b93c5c7-a8f6-4f05-96ad-39737c289827 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.012206 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-14eb09bf-73c4-4b02-a5dc-4e7107e791fc req-3b93c5c7-a8f6-4f05-96ad-39737c289827 service nova] Creating event network-vif-plugged:bb69988a-2d0c-4a82-9daa-b671976e609d for instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 on hv-cinder-79578 May 13 13:50:37.022123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-14eb09bf-73c4-4b02-a5dc-4e7107e791fc req-3b93c5c7-a8f6-4f05-96ad-39737c289827 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050645 May 13 13:50:37.027317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 119/242] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:37.134571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:37.135186 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:37.141078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.141517 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.142306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.142729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.260594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:37.262651 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:37.271240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.272036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.273108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.273671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.303815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.313241 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.315117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.316405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-082fb216-38ce-4451-be9e-e16e8598ebe4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.185820 May 13 13:50:37.317524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 124/243] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:37 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:37.519141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:37.520296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:37.534958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.535955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.538457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.539391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.548641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.560602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-48e295c8-4dfc-4023-bcef-d604878f65bb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.306153 May 13 13:50:37.563380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 120/244] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:37 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:37.668960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:37.669791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:37.677920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.678833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.679829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.680468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.830102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.837748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-79f9363f-b492-406a-96bb-3cbc41f48c6e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1321 microversion: 2.1 time: 0.323849 May 13 13:50:37.846981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 125/245] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:37 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:37.933917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:37.949141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d34fe219-12bf-4583-9461-77e03175760e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1315 microversion: 2.1 time: 0.284276 May 13 13:50:37.949688 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 121/246] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:37 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:37.983404 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:37.986420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:37.992626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.993185 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:37.994022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:37.994881 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.063005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:38.075131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-308513b3-5d93-4392-b6ed-6aa5e17e4fdf tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1287 microversion: 2.1 time: 0.095431 May 13 13:50:38.075961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 126/247] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:37 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:38.335637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:38.337292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:38.345949 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.346680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.347737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.348475 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.580579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:38.581187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:38.590167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.591787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.593816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.595776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.753161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:38.761212 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:38.763016 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:38.764385 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0f3f0c15-824c-48a7-9299-29b908db9859 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.434818 May 13 13:50:38.764998 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 122/248] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:38 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:38.856487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:38.857401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:38.868503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.869759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.871432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.872341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.909567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:38.923595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3b49e55b-5342-4735-af04-5d088fd04768 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.346894 May 13 13:50:38.926611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 127/249] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:38 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:38.966829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:38.967888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:38.983559 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.984662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:38.985627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:38.986374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.173519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:39.187859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fad7e0b4-ab1d-479b-871e-e130683726f6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1516 microversion: 2.1 time: 0.337193 May 13 13:50:39.194087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 123/250] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:38 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:39.194087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:39.194573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:39.214213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.215984 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.218712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.219663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.246929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:39.257066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bebdd43b-6e99-4991-97c7-7051afadfaea tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1502 microversion: 2.1 time: 0.292064 May 13 13:50:39.257913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 128/251] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:38 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:39.271892 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:39.272949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:39.291037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.291643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.292345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.292773 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.385903 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lazy-loading 'flavor' on Instance uuid efa256c0-8e95-448c-8c8b-f639d17d1ade {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:50:39.621200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9a1e78ec-4a68-4316-8756-20bd1227f7f3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade/action" status: 200 len: 32 microversion: 2.1 time: 0.361075 May 13 13:50:39.622177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 129/252] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:50:39 2022] POST /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:50:39.632940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:39.633919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:39.640585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.641372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.642434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.643016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.650872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:39.661298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e6324674-c813-45f3-8d59-411e63dfc45e tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.470142 May 13 13:50:39.671371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 124/253] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:39 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:39.783605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:39.784284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:39.793100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.793698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:39.794636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:39.795202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:40.188050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.197991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.199271 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.200864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5e9751a6-7a58-47d6-8347-a2169c070427 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1407 microversion: 2.20 time: 0.421582 May 13 13:50:40.201546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 125/254] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:39 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:40.206503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:40.207114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:40.209898 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.217374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:40.217811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:40.218605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:40.218850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-62f2571d-e92b-4d37-87f3-9240d0025977 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.590756 May 13 13:50:40.219027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:40.219559 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 130/255] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:39 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:40.492808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.518571 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b614c2ee-55d8-4fa1-868d-d762e55682ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.315572 May 13 13:50:40.529071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 126/256] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:40 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:40.678861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:40.679459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:40.686338 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:40.687009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:40.687956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:40.688914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:40.871094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:40.881241 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-313266b2-f5fb-4b5e-be28-67ff69596b67 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.206203 May 13 13:50:40.882993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 131/257] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:40 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:41.217763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:41.218918 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:41.225314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.225963 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.226982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.227577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.241815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:41.243262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:41.255543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.256443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.257374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.257946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.428704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:41.438274 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:41.440233 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:41.441935 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b1964bee-8bd4-422a-a690-51884668cdb6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1600 microversion: 2.20 time: 0.227759 May 13 13:50:41.443137 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 127/258] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:50:41 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1600 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:50:41.462607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:41.463813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:41.477719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.478358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.480228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.481153 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.531929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:41.540798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-80f79a8d-39cf-4fe0-ba82-22e549eb4a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.308365 May 13 13:50:41.556949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 132/259] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:41 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:41.561939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:41.562588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:41.575567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.576015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.576803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.577237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.739685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f1c6cd5b-48a3-4260-8291-58451428ca1c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.277623 May 13 13:50:41.740607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 128/260] 10.222.0.24 () {60 vars in 1315 bytes} [Fri May 13 13:50:41 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-interface => generated 285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:50:41.870992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:41.881464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cce8f2ea-9573-4a01-8c64-30cd172e3409 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.321069 May 13 13:50:41.883198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 133/261] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:41 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:41.898980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:41.899891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:41.909686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.910156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.912275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.913554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.946670 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-d6c276f3-e13f-44ff-92b0-7643fc5d6e1e req-64deee2a-6e8d-4d3b-b175-6e6a4a35d84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f888a0eb-66c0-4c4f-8340-248494490ff7", "tag": "9aaef1c1-82c7-49c6-a833-1a2d316410f8"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:41.959915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-d6c276f3-e13f-44ff-92b0-7643fc5d6e1e req-64deee2a-6e8d-4d3b-b175-6e6a4a35d84e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:41.960685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-d6c276f3-e13f-44ff-92b0-7643fc5d6e1e req-64deee2a-6e8d-4d3b-b175-6e6a4a35d84e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:41.983329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-d6c276f3-e13f-44ff-92b0-7643fc5d6e1e req-64deee2a-6e8d-4d3b-b175-6e6a4a35d84e service nova] Creating event network-changed:9aaef1c1-82c7-49c6-a833-1a2d316410f8 for instance f888a0eb-66c0-4c4f-8340-248494490ff7 on hv-cinder-79578 May 13 13:50:41.990285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-d6c276f3-e13f-44ff-92b0-7643fc5d6e1e req-64deee2a-6e8d-4d3b-b175-6e6a4a35d84e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046712 May 13 13:50:41.991376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 134/262] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:42.000171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9128296-6534-476e-8994-fcc1deb6ac02"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:42.001611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:42.022167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:42.022813 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:42.025069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:42.025662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:42.215437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:42.224687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-de2d2fa2-fbe5-46ee-80ec-67d05425b84a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.329615 May 13 13:50:42.235063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 129/263] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:41 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:42.563502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:42.564124 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:42.583968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:42.584407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:42.597370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:42.598736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:43.091996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:43.102343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-daed16a8-2d26-4f5f-af2b-713120cda505 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.548123 May 13 13:50:43.103588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 130/264] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:42 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:43.117024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-397312232", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "networks": [{"uuid": "01225bc8-2a83-4ab7-a40f-c7a81d4023f3"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:43.180711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] validate_networks() for [('01225bc8-2a83-4ab7-a40f-c7a81d4023f3', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:50:43.828620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:50:43.829169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:50:43.829595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:50:43.830117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:50:43.830612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:50:43.840568 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:43.841061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:43.841898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:43.842364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:43.859666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Getting quotas for project 394c59ac8c644012b31e7e39c8d49c98. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:50:43.863902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Getting quotas for user 55015ad2822f43bda0ebc0ba93d3827d and project 394c59ac8c644012b31e7e39c8d49c98. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:50:43.875293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:50:43.877553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:50:43.927656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1d1eea95-de90-4c31-a72e-646519f757ce tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819384 May 13 13:50:43.928615 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 131/265] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:50:43.933822 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:43.938773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:43.946654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:43.947458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:43.948300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:43.948737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.132289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:44.140409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9ce8c94c-8ea8-4fb9-9158-fff8f34aeee4 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1363 microversion: 2.1 time: 0.210562 May 13 13:50:44.141127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 132/266] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:43 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:44.146174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:44.146807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:44.153319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:44.153749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.154606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:44.155198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.293096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:44.300342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c148d188-7e2a-46b7-8b87-ee411b44d537 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.158110 May 13 13:50:44.301138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 133/267] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:44 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:44.311673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-38ddf456-4d04-491c-ba56-87292aba5eb2 req-57637522-b2ba-4015-98f1-1ff75502b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:44.321111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-38ddf456-4d04-491c-ba56-87292aba5eb2 req-57637522-b2ba-4015-98f1-1ff75502b2bc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:44.321787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-38ddf456-4d04-491c-ba56-87292aba5eb2 req-57637522-b2ba-4015-98f1-1ff75502b2bc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.334141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-38ddf456-4d04-491c-ba56-87292aba5eb2 req-57637522-b2ba-4015-98f1-1ff75502b2bc service nova] Creating event network-changed:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:50:44.339401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-38ddf456-4d04-491c-ba56-87292aba5eb2 req-57637522-b2ba-4015-98f1-1ff75502b2bc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 May 13 13:50:44.340101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 134/268] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:44.345912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0b824ce7-8d3c-4af5-8a2d-e84083886b9f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:44.346797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0b824ce7-8d3c-4af5-8a2d-e84083886b9f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:44.414487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0b824ce7-8d3c-4af5-8a2d-e84083886b9f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:44.421192 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0b824ce7-8d3c-4af5-8a2d-e84083886b9f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1213 microversion: 2.1 time: 0.079780 May 13 13:50:44.421746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 135/269] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:44 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:44.426585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:44.427171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:44.433393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:44.433831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.434614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:44.435041 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:44.578968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:44.590764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-93c25734-6658-4fc2-a1b0-d14d73f9c115 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.167701 May 13 13:50:44.591573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 136/270] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:44 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:44.900708 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-89ba2b11-4df3-4ab9-97f1-1835b62b3423 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "POST /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.907621 May 13 13:50:44.901306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 135/271] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:50:41 2022] POST /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624/os-volume_attachments => generated 194 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:45.158336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:45.158936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:45.165855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.166330 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.167111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.167550 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.304090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:45.311744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-491cce9f-bc34-4215-9466-54a9ec2ea3e5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1548 microversion: 2.1 time: 0.157368 May 13 13:50:45.312306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 137/272] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:45 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:45.318980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:45.319683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:45.327091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.327623 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.328478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.328985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.329682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:45.330228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:45.336828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.337338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.338181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.338647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.420047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-181842da-9094-49ab-8a1e-875d6c8dea03 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094934 May 13 13:50:45.420828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 138/273] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 13:50:45 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:45.441110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:45.442087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:45.448847 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.449321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.450133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.450551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.546017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:45.555322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f4d01d1c-a830-498f-8f18-833101fdb545 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.242096 May 13 13:50:45.557513 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 136/274] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:45 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:45.607559 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:45.608167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:45.614584 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.615032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.615808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:45.616242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:45.864669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:45.873335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2818ce41-f770-433b-abd0-e84b6aafa0af tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.269662 May 13 13:50:45.873994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 137/275] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:45 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:45.903542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:45.911064 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5d55e05e-c1fd-4c97-b3e4-da0f79551602 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1217 microversion: 2.1 time: 0.474804 May 13 13:50:45.911719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 139/276] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:45 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1217 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:46.573204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:46.573776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:46.582421 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.583165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:46.584157 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.584949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:46.899744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:46.903748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:46.907320 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:46.932262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0aa81fc5-c51d-47fb-834b-c89efa06e86a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.362533 May 13 13:50:46.945301 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 138/277] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:46 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:46.945853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.945853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:46.945853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.945853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:46.948135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:46.950781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:46.969844 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.970371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:46.972395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:46.972957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:47.045860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:47.056133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3a313643-0a57-44e1-a913-c407d33818e3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1271 microversion: 2.1 time: 0.116394 May 13 13:50:47.057076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 139/278] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:46 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:47.454835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:47.463946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7a28d671-5b93-4598-8a69-bb2b3f718d36 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.576855 May 13 13:50:47.465209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 140/279] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:46 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:47.750738 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-fde005e6-b86a-4788-804a-6f372e3f8420 req-87e7949b-c7a4-4489-8ee7-2688bda18086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fef620-abd7-40d5-a072-6af7a0a22ad0", "tag": "bb69988a-2d0c-4a82-9daa-b671976e609d"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:47.762621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-fde005e6-b86a-4788-804a-6f372e3f8420 req-87e7949b-c7a4-4489-8ee7-2688bda18086 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:47.763225 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-fde005e6-b86a-4788-804a-6f372e3f8420 req-87e7949b-c7a4-4489-8ee7-2688bda18086 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:47.777793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-fde005e6-b86a-4788-804a-6f372e3f8420 req-87e7949b-c7a4-4489-8ee7-2688bda18086 service nova] Creating event network-changed:bb69988a-2d0c-4a82-9daa-b671976e609d for instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 on hv-cinder-79578 May 13 13:50:47.784623 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-fde005e6-b86a-4788-804a-6f372e3f8420 req-87e7949b-c7a4-4489-8ee7-2688bda18086 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038512 May 13 13:50:47.786614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 140/280] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:47.954240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:47.955648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:47.968809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:47.970144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:47.971370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:47.972145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:48.076387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:48.078379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:48.087374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:48.088809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:48.089784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:48.090469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:48.169020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:48.178886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc5d135f-c56a-42ce-98b0-28b35a26649c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.229914 May 13 13:50:48.189235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 141/281] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:47 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:48.274985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:48.283170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d8d12b55-0fa0-4737-bcad-5dffcf6af945 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.213190 May 13 13:50:48.283904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 141/282] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:48 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:48.482730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:48.483348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:48.502158 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:48.502582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:48.503355 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:48.503775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:48.667873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:48.676113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e47a58b4-f6ab-4279-8014-740316a42ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.196972 May 13 13:50:48.676873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 142/283] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:48 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:49.197675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:49.198327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:49.204899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.205354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.206154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.206589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.302412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:49.303743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:49.313792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.314353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.315245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.315760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.363929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:49.371583 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7b4f7024-69a3-4061-adbf-0e71ef45925f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.179336 May 13 13:50:49.384455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 142/284] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:49 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:49.452346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:49.460302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-65acecbb-bb9c-41ca-8a05-ea5fb5c0f033 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.163131 May 13 13:50:49.460878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 143/285] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:49 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:49.693941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:49.694845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:49.701346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.702112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.703136 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:49.703638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:49.855387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:49.863906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ab6ea18d-1835-4116-ae0a-4ffc76f73810 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.173879 May 13 13:50:49.865015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 143/286] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:49 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:50.389356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:50.389966 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:50.405783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.406263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.407043 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.407472 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.477407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:50.478009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:50.485286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.486135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.487174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.487753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.614621 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:50.624529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7221fa3d-eb41-4173-a0aa-e93618cd9ee1 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.238033 May 13 13:50:50.627083 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 144/287] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:50 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:50.881047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:50.881543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:50.885235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:50.893470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.893917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.894894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:50.895420 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:50.896961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ee91d8f6-c127-41ad-be7f-c8e14a507261 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.423425 May 13 13:50:50.910157 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 144/288] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:50 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:51.068067 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:51.075608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b85dbfe5-3312-4753-882a-554b4fbf4ffd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.198932 May 13 13:50:51.076354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 145/289] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:50 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:51.482077 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-6bc9712c-74c1-454f-8c5a-d0af374250b2 req-c4406bed-dbd4-48ea-83c7-f0b39b39371d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510e2cc5-610f-4a58-aa08-914710d5b808", "tag": "5731f2a6-40d5-4e6a-a05c-b13bf5a11a93"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:51.491083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-6bc9712c-74c1-454f-8c5a-d0af374250b2 req-c4406bed-dbd4-48ea-83c7-f0b39b39371d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:51.491403 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-6bc9712c-74c1-454f-8c5a-d0af374250b2 req-c4406bed-dbd4-48ea-83c7-f0b39b39371d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:51.515686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-6bc9712c-74c1-454f-8c5a-d0af374250b2 req-c4406bed-dbd4-48ea-83c7-f0b39b39371d service nova] Creating event network-changed:5731f2a6-40d5-4e6a-a05c-b13bf5a11a93 for instance 510e2cc5-610f-4a58-aa08-914710d5b808 on hv-cinder-79578 May 13 13:50:51.522400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-6bc9712c-74c1-454f-8c5a-d0af374250b2 req-c4406bed-dbd4-48ea-83c7-f0b39b39371d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044705 May 13 13:50:51.523690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 145/290] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:51.643159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:51.650344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:51.659366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:51.660280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:51.661278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:51.661843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:51.805227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:51.813375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-54b329aa-b4c5-4360-b070-50b96d250763 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.174342 May 13 13:50:51.814237 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 146/291] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:51 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:51.916735 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:51.917689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:51.923862 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:51.924376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:51.925189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:51.925770 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:52.085883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:52.093096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:52.093700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:52.095205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6ab8150b-83bb-4f16-aa4e-dd77c4bf4ffd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.183035 May 13 13:50:52.095770 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 146/292] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:51 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:52.099959 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:52.100404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:52.101209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:52.101649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:52.234070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:52.241619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-457fe831-526e-4526-b06f-b59ee709d576 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.152776 May 13 13:50:52.242188 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 147/293] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:52 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:52.833102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:52.833898 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:52.842789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:52.843372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:52.844422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:52.844961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:52.998704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:53.008058 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b1c6d704-cbcb-4d4c-bf38-3b56743633b5 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.180210 May 13 13:50:53.008612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 147/294] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:52 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:53.112019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:53.112611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:53.118946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:53.119468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:53.120560 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:53.121205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:53.258360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:53.259356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:53.266652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:53.267907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:53.268940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:53.269889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:53.272834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:53.284819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e59a846-2dde-4552-b90f-eee71b6ecf2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.176582 May 13 13:50:53.286592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 148/295] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:53 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:53.327184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-b41a9b08-8ff9-4a01-acc4-533a77a1d242 req-560dcd7c-1cf7-43bd-a5f8-97532c501cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f888a0eb-66c0-4c4f-8340-248494490ff7", "name": "network-vif-plugged", "status": "completed", "tag": "9aaef1c1-82c7-49c6-a833-1a2d316410f8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:53.338978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b41a9b08-8ff9-4a01-acc4-533a77a1d242 req-560dcd7c-1cf7-43bd-a5f8-97532c501cbf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:53.339810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b41a9b08-8ff9-4a01-acc4-533a77a1d242 req-560dcd7c-1cf7-43bd-a5f8-97532c501cbf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:53.356335 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-b41a9b08-8ff9-4a01-acc4-533a77a1d242 req-560dcd7c-1cf7-43bd-a5f8-97532c501cbf service nova] Creating event network-vif-plugged:9aaef1c1-82c7-49c6-a833-1a2d316410f8 for instance f888a0eb-66c0-4c4f-8340-248494490ff7 on hv-cinder-79578 May 13 13:50:53.363139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-b41a9b08-8ff9-4a01-acc4-533a77a1d242 req-560dcd7c-1cf7-43bd-a5f8-97532c501cbf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042294 May 13 13:50:53.375541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 149/296] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:50:53.466686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:53.474866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7ee155a8-7d55-4435-a660-d4a488bcacd1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.221050 May 13 13:50:53.475542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 148/297] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:53 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:54.030995 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:54.032034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:54.042871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.043599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.044832 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.045549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.189970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:54.198091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b5f3c10a-846c-4448-978a-3fad49a75238 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.174411 May 13 13:50:54.198677 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 150/298] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:54 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:54.305394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:54.306228 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:54.315974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.316948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.317710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.318175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.449255 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:54.456812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-145e555b-bcc4-473b-9808-3f1b0fc0ed18 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.158004 May 13 13:50:54.458244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 149/299] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:54 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:54.492418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:54.493018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:54.498952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.499392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.500147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:54.500602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:54.645510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:54.653371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3850d863-60cc-4ea6-a246-46b46a7d7375 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.164886 May 13 13:50:54.654022 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 151/300] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:54 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:55.218062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:55.218747 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:55.226251 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.226703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.227477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.227899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.365749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:55.373387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6a4a5535-10cb-43fa-a4a6-5ad2e696b888 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.159309 May 13 13:50:55.373996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 150/301] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:55 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:55.474265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:55.475065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:55.481398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.481840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.482620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.483036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.627006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:55.634415 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b24e7e1b-6684-4bcf-93b9-e2fe0176fa2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.164037 May 13 13:50:55.635680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 152/302] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:55 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:55.670299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:55.671008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:55.677662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.678136 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.678902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:55.679485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:55.813281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:55.821166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-be521d9b-a715-4061-b789-3dd0682b3c7d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.154925 May 13 13:50:55.821699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 151/303] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:55 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:56.391545 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:56.392304 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:56.398647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.399171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:56.400319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.400818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:56.536772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:56.557519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a9d0e7f8-aea6-4caa-9afe-d5b956bfee90 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.170156 May 13 13:50:56.558363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 153/304] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:56 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:56.653481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:56.654247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:56.661115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.662447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:56.663281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.663871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:56.797718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:56.809118 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-47c40948-ca73-47af-94bb-0ad3ede42b7d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.159651 May 13 13:50:56.809929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 152/305] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:56 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:56.838541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:56.839145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:56.845844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.846312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:56.847071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:56.847528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.008482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:57.016856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-02d2f59a-d7e0-4691-839e-3a82eddcf289 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.182229 May 13 13:50:57.017451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 154/306] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:56 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:57.574954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:57.575480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:57.581433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:57.581877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.583183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:57.583694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.829073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:57.830595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:57.832661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:57.837870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:57.838715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.839699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:57.840625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.842823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-486db498-2ce9-488a-8801-eeabd14ef9d3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.271774 May 13 13:50:57.844038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 153/307] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:57 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:57.896633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-1dfe5201-006f-4367-bc08-cb7556f85478 req-62a7761d-f6ae-4ae1-8271-a3ee3bd2e62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510e2cc5-610f-4a58-aa08-914710d5b808", "name": "network-vif-plugged", "status": "completed", "tag": "5731f2a6-40d5-4e6a-a05c-b13bf5a11a93"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:50:57.915619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-1dfe5201-006f-4367-bc08-cb7556f85478 req-62a7761d-f6ae-4ae1-8271-a3ee3bd2e62b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:57.916350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-1dfe5201-006f-4367-bc08-cb7556f85478 req-62a7761d-f6ae-4ae1-8271-a3ee3bd2e62b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:57.934535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-1dfe5201-006f-4367-bc08-cb7556f85478 req-62a7761d-f6ae-4ae1-8271-a3ee3bd2e62b service nova] Creating event network-vif-plugged:5731f2a6-40d5-4e6a-a05c-b13bf5a11a93 for instance 510e2cc5-610f-4a58-aa08-914710d5b808 on hv-cinder-79578 May 13 13:50:57.940098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-1dfe5201-006f-4367-bc08-cb7556f85478 req-62a7761d-f6ae-4ae1-8271-a3ee3bd2e62b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049740 May 13 13:50:57.940693 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 154/308] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:50:57.995618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:58.003486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-32d176a0-eba2-4ea9-bf66-fc9043c90807 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.178437 May 13 13:50:58.004557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 155/309] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:57 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:58.035217 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:58.035913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:58.042002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.042480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.043235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.043665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.177107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:58.185357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-78054552-c05d-4a25-9e21-9db1758124de tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.154867 May 13 13:50:58.186272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 155/310] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:58 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:58.859360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:58.859968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:58.866546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.867017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.867789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.868225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.916295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:58.918966 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:58.925523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.925968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.926851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:58.927252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:58.954247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:50:59.008073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:59.015899 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-31c58728-15cc-47fb-a36c-86c8494235e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.160460 May 13 13:50:59.016679 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 156/311] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:58 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:59.023318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:59.023915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:59.030020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.030498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.031249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.031699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.043395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-af309f6b-57ce-4b5a-bd52-ed313cfd8ca0 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 204 len: 0 microversion: 2.1 time: 0.130764 May 13 13:50:59.043985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 156/312] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:50:58 2022] DELETE /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:50:59.053823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:59.054575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:59.060294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.060741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.061507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.061941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.174552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:59.182426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-83bc6abb-aeae-498a-8a46-e880b74df909 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.164812 May 13 13:50:59.183369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 157/313] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:59 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:50:59.191031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:59.199286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6fbef531-f957-4e32-8d26-be11e059e903 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.150550 May 13 13:50:59.199947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 157/314] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:59 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:50:59.203086 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:50:59.203745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:50:59.210352 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.210792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.211555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:50:59.211983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:50:59.350316 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:50:59.358006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c366ca42-a1c1-4727-b7ac-1d1169d8f381 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.158636 May 13 13:50:59.358695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 158/315] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:50:59 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:00.034357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:00.035707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:00.044327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.045306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.046604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.047453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.190101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:00.200666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1be21134-02fe-4f72-8cfd-41c6e158aed9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.170118 May 13 13:51:00.201404 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 158/316] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:00 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:00.202436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:00.203050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:00.209345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.209797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.210595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.211029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.216383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:00.216990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:00.223221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.223670 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.224441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.224871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.341051 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:00.348839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-79bee455-e34a-436a-99dd-31202a6a5748 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.151831 May 13 13:51:00.349435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 159/317] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:00 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:00.353244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:00.361024 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7e5b19b9-5bda-4c22-8724-2100acbf1d1c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.148377 May 13 13:51:00.361570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 159/318] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:00 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:00.375490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:00.376090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:00.382448 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.382881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.383641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:00.384076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:00.515420 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:00.523222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8a707d3b-0ce2-433f-9304-b5536b559bbd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.151430 May 13 13:51:00.523863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 160/319] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:00 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:01.222212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:01.223387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:01.231226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.231680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.232579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.233086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.361138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:01.365577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:01.366181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:01.368620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f9dece89-2d7d-4caa-9006-47874e415e70 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.152854 May 13 13:51:01.369265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 160/320] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:01 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:01.373197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.373640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.374452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.374877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.377781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:01.378958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:01.385111 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.385561 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.386364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.386804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.502454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:01.509958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6a57f0e6-0c6f-43a0-ab86-2fe7de5ea8de tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.148534 May 13 13:51:01.510553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 161/321] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:01 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:01.519362 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:01.528386 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fbf0a474-2343-41d6-917c-643d438f724d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.154481 May 13 13:51:01.528951 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 161/322] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:01 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:01.540554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:01.541160 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:01.547186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.547634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.548536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:01.548969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:01.683048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:01.694132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bdc1b8c0-1e4a-4881-b5ea-ede6df844db6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.157126 May 13 13:51:01.694937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 162/323] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:01 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:02.389769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:02.390468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:02.399045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.399497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.400592 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.401025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.527230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:02.527868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:02.534012 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.534499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.535344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.535856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.545473 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:02.553527 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0679fbf6-5e1c-44d9-80c8-6b837b939300 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.170389 May 13 13:51:02.554133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 162/324] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:02 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:02.558579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:02.559414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:02.565634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.566081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.567238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.567689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.665714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:02.674012 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ad020a66-be84-47de-a04c-06d7a43c6791 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.150931 May 13 13:51:02.674597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 163/325] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:02 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:02.699247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:02.707423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2a168b91-e1ec-4175-90c2-1375138cd315 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.152336 May 13 13:51:02.709308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 163/326] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:02 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:02.714466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:02.715076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:02.721357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.722034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.722790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:02.723299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:02.867287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:02.875062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d5be01e3-8b7a-425d-8a0e-e602808fe59c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.164414 May 13 13:51:02.875624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 164/327] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:02 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:03.570533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:03.571073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:03.577868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.578358 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.579126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.579558 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.690861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:03.692133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:03.701783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.701783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.701783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.701783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.711229 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:03.718923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-16da99f4-f64f-4d10-ade9-fef763fdfee9 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.152471 May 13 13:51:03.720019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 164/328] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:03 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:03.724767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:03.725365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:03.731782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.732215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.732979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.733408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.866900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:03.873386 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:03.877805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1a73b078-c367-486b-848f-4617b9d884d0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.190866 May 13 13:51:03.878413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 165/329] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:03 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:03.881327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0da83f46-6972-416f-a736-0a7a2edb079c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.160131 May 13 13:51:03.881901 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 165/330] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:03 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:03.892902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:03.893890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:03.901666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.902179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:03.902948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:03.903379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.033330 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:04.047400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-21fbe6e2-c9bb-43ee-9af5-72d71c2d1017 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.159080 May 13 13:51:04.048440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 166/331] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:03 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:04.740177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:04.740753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:04.747529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.747968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.748727 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.749156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.895498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:04.896253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:04.896442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:04.903454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.903925 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ed3c54e9-bee2-488e-b069-00b803e0fc76 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.169895 May 13 13:51:04.904047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.904675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 166/332] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:04 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:04.909682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:04.910304 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:04.914095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.914587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.916041 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.916492 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:04.917382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:04.917815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:05.055499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:05.059011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:05.064176 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cec72043-2db0-4f91-b918-c36ac1b6f8c6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.172972 May 13 13:51:05.070094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 167/333] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:04 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:05.070243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-54bfbeae-a5c1-4f2d-a423-973de8e6c42a tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.161808 May 13 13:51:05.070243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 167/334] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:04 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:05.078695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:05.079396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:05.085957 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:05.086511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:05.087376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:05.087873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:05.222018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:05.229765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f4b18347-a25b-441e-a491-eb735cf519ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.163510 May 13 13:51:05.230172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 168/335] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:05 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:05.920954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:05.921514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:05.931608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:05.931843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:05.932611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:05.933038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.082477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:06.083218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:06.090091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.090577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.091357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.091791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.108965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:06.117016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a599daa1-4ddd-48e2-bd9f-702da63c805a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.199979 May 13 13:51:06.137001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 168/336] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:05 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:06.142097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:06.142711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:06.149099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.150118 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.151126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.151761 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.243942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:06.251635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-91f1c812-b911-4fa8-b878-58f9159c80ec tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.174562 May 13 13:51:06.252210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 169/337] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:06 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:06.257396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:06.258115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:06.264090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.264734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.265503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:06.266123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:06.302031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:06.311571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2ba27e04-7e7d-403b-b1ad-2b3f3e80b616 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.173219 May 13 13:51:06.312141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 169/338] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:06 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:06.396460 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:06.404174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2cdcb9c8-7251-49d6-8387-761287547c30 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.150889 May 13 13:51:06.404722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 170/339] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:06 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:07.134453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:07.135043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:07.142374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.142835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.143638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.144097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.268779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:07.269576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:07.276489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.276995 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.277966 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.278495 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.292801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:07.301277 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5db775ad-c452-44a4-965d-2f04baca2f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.171065 May 13 13:51:07.302116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 170/340] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:07 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:07.328498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:07.329104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:07.335209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.335657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.336426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.336858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.426367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:07.434250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d04e3cb5-f1dd-4e2f-a930-e18e848e97fd tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.169443 May 13 13:51:07.434867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 171/341] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:07 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:07.439435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:07.440113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:07.446072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.446595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.447421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:07.447914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:07.474760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:07.482916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c8b3abee-a04d-421f-a38b-83344912f416 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.158119 May 13 13:51:07.483483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 171/342] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:07 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:07.580749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:07.588938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1d83e8d7-9264-4de6-9fea-0752b8425625 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.152938 May 13 13:51:07.589496 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 172/343] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:07 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:08.323177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:08.324131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:08.334861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.335365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.336106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.336540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.450756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:08.451363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:08.457201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.457642 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.458526 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.458933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.466933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:08.474324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5981d398-c128-47dd-b817-d761e1eba360 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.157883 May 13 13:51:08.474887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 172/344] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:08 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:08.501792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:08.502435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:08.509947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.510583 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.511164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.511588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.591774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:08.599290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e5fb7b1b-5dc5-496c-841d-6952fc4c6f7b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.152435 May 13 13:51:08.599882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 173/345] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:08 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:08.607142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:08.607810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:08.613662 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.614218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.615063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:08.615583 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:08.643971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:08.652498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c146215f-cd19-4495-aeae-aa49c77dbe91 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.155720 May 13 13:51:08.653078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 173/346] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:08 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:08.744019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:08.751719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6a7b8290-787b-43e2-8903-01105b6dfde4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.148326 May 13 13:51:08.752275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 174/347] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:08 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:09.495481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:09.496465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:09.506611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.507033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.507817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.508245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.616402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:09.616989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:09.623288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.623727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.624487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.624906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.635177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:09.642515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e21de832-1d15-4ddd-abbc-0b83908acecb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1317 microversion: 2.1 time: 0.153600 May 13 13:51:09.643054 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 174/348] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:09 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:09.669535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:09.670169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:09.676154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.676596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.677395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.677816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.757316 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:09.765361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-500530a7-d3c9-4e9a-b1b8-161877401fa9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.152920 May 13 13:51:09.766057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 175/349] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:09 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:09.770753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:09.771971 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:09.778419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.778959 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.779794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:09.780286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:09.809933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:09.818672 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-205c8444-8382-4129-ad41-4dd13b1fb14c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.152669 May 13 13:51:09.819200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 175/350] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:09 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:09.913297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:09.920803 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1a63b8d2-9c30-4d85-b28c-2e14a6d296dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.153560 May 13 13:51:09.921350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 176/351] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:09 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:10.664752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:10.665768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:10.677563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.677953 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.678886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.679367 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.782980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:10.783668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:10.790010 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.790576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.791403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.791897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.814214 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:10.823139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1869aa45-77f4-40b3-94fd-0447007b0c92 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1506 microversion: 2.1 time: 0.165938 May 13 13:51:10.823676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 176/352] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:10 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:10.836642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:10.837129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:10.843340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.843868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.844710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.845221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.930798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:10.939301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a4b294e-5b61-4dd1-b3bb-3a72e9320470 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.160086 May 13 13:51:10.940218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 177/353] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:10 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:10.944933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:10.945769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:10.952389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.953120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.954343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:10.954909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:10.984553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:10.993123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d32e76b2-541e-42c0-9ecc-7980ecf981f2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.161025 May 13 13:51:10.993912 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 177/354] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:10 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:11.091650 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:11.099016 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d8621b66-a5a6-4d12-b02b-2cb6da4d8365 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.157609 May 13 13:51:11.099598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 178/355] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:10 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:11.961713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:11.962910 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:11.976099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:11.976099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:11.976099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:11.976099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:12.010478 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:12.011029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:12.017875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:12.019281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:12.019281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:12.019689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:12.124474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:12.137044 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-01873f83-3214-401a-8858-23aa97b8b559 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.182815 May 13 13:51:12.137603 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 178/356] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:11 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:12.142228 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:12.143273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:12.150389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:12.151266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:12.151974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:12.152880 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:12.182287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:12.208710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-409f4e93-5b00-46c0-82ad-3c2783a237d4 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.201801 May 13 13:51:12.209645 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 179/357] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:12 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:12.310625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:12.319563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-43ac02a7-0aa1-4f88-a635-e77b1bd2ec04 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.180863 May 13 13:51:12.320446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 179/358] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:12 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:13.155104 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:13.155748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:13.162488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.162926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.163679 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.164111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.228083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:13.228719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:13.235399 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.235851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.236622 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.237055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.301647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:13.309344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0e19e2cc-92fe-4477-8011-c65ac6bf5d79 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.158207 May 13 13:51:13.318558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 180/359] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:13 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:13.346427 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:13.347034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:13.353249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.353706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.354706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:13.355145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:13.373203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:13.385471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a8590063-27f0-4cae-8c35-1ba91ce36882 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.161449 May 13 13:51:13.386052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 180/360] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:13 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:13.494286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:13.502104 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0e684e91-bd10-44a2-bc00-7bc73ac8e8e2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.159480 May 13 13:51:13.502674 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 181/361] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:13 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:14.326549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:14.327153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:14.333906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.335078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.335862 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.336305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.404617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:14.405288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:14.411771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.412365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.413079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.413502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.478540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:14.486052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-64d35770-9c6c-4041-affd-eccbb5a257d8 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.163698 May 13 13:51:14.486630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 181/362] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:14 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:14.518955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:14.519648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:14.526444 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.526895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.527656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:14.528089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:14.541844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:14.550820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c4304f60-44f5-4b01-ab69-4f11334c13fe tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.150600 May 13 13:51:14.551539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 182/363] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:14 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:14.660956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:14.669611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3af58ed7-59e2-4bf8-9d29-3a6415143a3a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.154464 May 13 13:51:14.670209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 182/364] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:14 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:15.503586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:15.504189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:15.510911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.511349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.512100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.512544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.567596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:15.568199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:15.575709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.576161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.576945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.577384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.653511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:15.661234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-13797061-bf3e-4c3a-88d2-eb8241f626aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.161792 May 13 13:51:15.661842 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 183/365] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:15 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:15.689171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:15.689682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:15.696329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.696903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.697842 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:15.698424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:15.711935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:15.720211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-042622b4-cb92-47b2-9b1b-32619465142e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.156465 May 13 13:51:15.720958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 183/366] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:15 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:15.833225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:15.840833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4153f17e-2bad-4052-a49b-7e41b6419971 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.155591 May 13 13:51:15.842235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 184/367] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:15 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:16.679085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:16.679691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:16.687800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.688258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.689033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.689471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.737073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:16.737648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:16.744321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.744844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.745638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.746084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.829983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:16.838852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6c7507cd-0083-43c7-9660-6952c4c893ba tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.163670 May 13 13:51:16.839434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 184/368] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:16 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:16.857809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:16.858468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:16.865402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.865874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.866976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:16.867408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:16.874229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:16.882597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6e2c78c1-b8f4-477c-b609-64f711ec0690 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.149444 May 13 13:51:16.883310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 185/369] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:16 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:16.999722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:17.011415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ee9e3be5-f998-4bf5-8d44-306039624a8f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.157094 May 13 13:51:17.012589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 185/370] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:16 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:17.855380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:17.855977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:17.862402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:17.862837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:17.863588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:17.864008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:17.900434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:17.901189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:17.907823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:17.908244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:17.909017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:17.909482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:18.003541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:18.011645 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e28e487-237f-40d8-91d5-58b11d9263aa tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.160022 May 13 13:51:18.018252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 186/371] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:17 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:18.029473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:18.030084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:18.036369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:18.036873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:18.038449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:18.038904 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:18.042682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:18.051119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-01beeb0b-e9b5-4992-b853-49b7c5993f28 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.155257 May 13 13:51:18.052044 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 186/372] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:17 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:18.175788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:18.184001 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-62bf1844-f027-465c-b06f-2abe2626eed2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.158764 May 13 13:51:18.184561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 187/373] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:18 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:19.033453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:19.034525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:19.046422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.047159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.048448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.049313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.068661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:19.069669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:19.076157 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.076580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.077351 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.077768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.180557 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:19.188480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3fd0381c-3117-46d9-9b54-a6c2dfd6d96d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.161489 May 13 13:51:19.189016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 187/374] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:19 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:19.200872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:19.201447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:19.207762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.208214 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.208977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:19.209597 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:19.216797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:19.225592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-db02ce8e-fcc9-41d1-9cf3-f041e75919a1 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.160695 May 13 13:51:19.226576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 188/375] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:19 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:19.348320 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:19.356156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6d074a6a-6303-4729-823a-36d7690eccdd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.159236 May 13 13:51:19.356717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 188/376] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:19 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:20.209060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:20.210843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:20.220190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.220912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.222206 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.222906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.243798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:20.244446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:20.250932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.251452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.252239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.252678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.359239 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:20.367193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a08d3a16-70d2-4397-a9ab-c38a0885842a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.164554 May 13 13:51:20.374831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 189/377] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:20 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:20.379678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:20.380282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:20.381795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:20.386353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.386806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.387608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:20.388018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:20.390985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-32ce2981-a889-418d-a386-bb1f280fc708 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.151296 May 13 13:51:20.391536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 189/378] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:20 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:20.523123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:20.531126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-65b2fec5-747b-4d9c-998d-725bf1e56665 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.155235 May 13 13:51:20.531794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 190/379] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:20 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:21.385427 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:21.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:21.394853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.395305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.398330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.398330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.408618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:21.409257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:21.416499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.416499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.416997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.417428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.544660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:21.551934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ffec3b04-f8db-439b-b70d-183b5ec0a50c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.172144 May 13 13:51:21.552503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 190/380] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:21 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:21.563899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:21.564687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:21.567148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:21.571477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.572033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.572928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:21.573464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:21.576159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7f225c8c-85f5-47a2-9d4c-213c3e550d94 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.171356 May 13 13:51:21.576788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 191/381] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:21 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:21.934505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:21.942074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4ff58cc8-f41b-420f-80a0-21ec9c4004d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.382687 May 13 13:51:21.942642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 191/382] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:21 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:22.572788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:22.573433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:22.580569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.581074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:22.581915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.582441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:22.594759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:22.595383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:22.602837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.603293 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:22.604055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.604485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:22.714599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:22.721890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fe447a8f-e305-489b-b5f5-243f58fe37ca tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.155595 May 13 13:51:22.722504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 192/383] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:22 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:22.739182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:22.748829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c6514431-9e3e-4a7f-956e-363f7325bccf tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.158379 May 13 13:51:22.749393 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 192/384] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:22 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:22.959538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:22.960143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:22.967004 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.967452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:22.968213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:22.968639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.255405 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:23.264714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d86ff2d3-44ae-4500-b452-7d2862d88771 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.309092 May 13 13:51:23.265254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 193/385] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:22 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:23.739332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:23.739917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:23.744306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-2b6ab6e5-8177-4d42-9f9b-75576de1376d req-15d0a409-3f3a-48ca-8d8c-91e6d11da5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe8806f-ef13-4621-9dea-850cdab53624", "name": "network-vif-unplugged", "status": "completed", "tag": "1463c1e5-8ddd-4a01-b534-d61cc17637a8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:23.748253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:23.749981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.750717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:23.751564 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.752709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-2b6ab6e5-8177-4d42-9f9b-75576de1376d req-15d0a409-3f3a-48ca-8d8c-91e6d11da5d1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:23.753145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-2b6ab6e5-8177-4d42-9f9b-75576de1376d req-15d0a409-3f3a-48ca-8d8c-91e6d11da5d1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.776771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-2b6ab6e5-8177-4d42-9f9b-75576de1376d req-15d0a409-3f3a-48ca-8d8c-91e6d11da5d1 service nova] Creating event network-vif-unplugged:1463c1e5-8ddd-4a01-b534-d61cc17637a8 for instance 5fe8806f-ef13-4621-9dea-850cdab53624 on hv-cinder-79578 May 13 13:51:23.782252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-2b6ab6e5-8177-4d42-9f9b-75576de1376d req-15d0a409-3f3a-48ca-8d8c-91e6d11da5d1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041837 May 13 13:51:23.783253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 194/386] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:23.788440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:23.789134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:23.796543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:23.796994 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.797774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:23.798629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:23.912453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:23.921563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-781de655-3826-4e3f-8726-24b6de0b7361 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.186106 May 13 13:51:23.922178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 193/387] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:23 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:23.942620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:23.951350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3767296c-dd52-4e0d-88c8-9bc584bc3bdd tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.167002 May 13 13:51:23.951913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 195/388] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:23 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:24.283218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:24.283915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:24.291188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.291642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:24.292451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.292866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:24.428690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:24.436699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b9196389-98c7-4c43-95d1-6b17a6caa66b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.158343 May 13 13:51:24.437261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 194/389] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:24 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:24.937789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:24.938415 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:24.944886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.945319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:24.946117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.946639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:24.969172 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:24.979298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:24.979298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.979760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:24.980818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:24.981323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:25.089766 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:25.097531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0112b7db-3bba-4d16-908c-9f29ff169824 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.163516 May 13 13:51:25.098265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 196/390] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:24 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:25.125797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:25.133657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-43c9f1ce-d5e4-4c63-b83f-45306b0ed300 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.168565 May 13 13:51:25.134354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 195/391] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:24 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:25.458900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:25.459606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:25.466805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:25.467252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:25.468026 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:25.468456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:25.606610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:25.614722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7ecf4e6e-46b6-4ead-833f-c59367e274f0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.159892 May 13 13:51:25.615540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 197/392] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:25 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:26.118775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:26.119931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:26.131274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.132084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.133314 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.134178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.151676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:26.152484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:26.158744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.159259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.160085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.160581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.266889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:26.275737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e5f1e75f-c207-461f-9919-5f3809227aee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.162633 May 13 13:51:26.276297 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 196/393] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:26 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:26.293944 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:26.302723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f8c6607d-c2be-431d-97f2-479274800613 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.155375 May 13 13:51:26.303322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 198/394] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:26 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:26.632504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:26.633110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:26.639735 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.640221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.640998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:26.641431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:26.773656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:26.781614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0f66a790-b6a5-4f98-a8b5-8a8b82b2855e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.153111 May 13 13:51:26.782198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 197/395] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:26 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:27.293061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:27.293689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:27.299939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.300391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.301153 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.301581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.324932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:27.325520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:27.332620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.333047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.333856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.334337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.443140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:27.453228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1899f162-88b3-4dee-9d98-99076edbfb71 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1313 microversion: 2.1 time: 0.164010 May 13 13:51:27.453829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 199/396] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:27 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:27.471902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:27.480140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-de979e58-ddec-4312-86dc-9a08f7d7a1b7 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1554 microversion: 2.1 time: 0.159861 May 13 13:51:27.480709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 198/397] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:27 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:27.806666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:27.807431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:27.816607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.817239 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.818230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:27.818771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:27.965216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:27.973620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-766fe8ee-c76a-4052-baeb-7a648d57026c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.173229 May 13 13:51:27.974240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 200/398] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:27 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:28.469972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:28.470756 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:28.478170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.478170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:28.478836 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.479273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:28.497633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:28.498261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:28.508935 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.509376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:28.510202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.510597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:28.587845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:28.596914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a3b39b0a-2f33-400a-a805-4cfef72ea35e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1512 microversion: 2.1 time: 0.103016 May 13 13:51:28.598380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 201/399] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:28 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:28.670288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-43dc8a68-8821-4e3b-ad69-96e592125bf8 req-d565edf3-27a9-4d7c-8d8d-956963ab5f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe8806f-ef13-4621-9dea-850cdab53624", "name": "network-vif-deleted", "tag": "1463c1e5-8ddd-4a01-b534-d61cc17637a8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:28.679018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-43dc8a68-8821-4e3b-ad69-96e592125bf8 req-d565edf3-27a9-4d7c-8d8d-956963ab5f3a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.679576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-43dc8a68-8821-4e3b-ad69-96e592125bf8 req-d565edf3-27a9-4d7c-8d8d-956963ab5f3a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:28.692606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-43dc8a68-8821-4e3b-ad69-96e592125bf8 req-d565edf3-27a9-4d7c-8d8d-956963ab5f3a service nova] Creating event network-vif-deleted:1463c1e5-8ddd-4a01-b534-d61cc17637a8 for instance 5fe8806f-ef13-4621-9dea-850cdab53624 on hv-cinder-79578 May 13 13:51:28.698587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-43dc8a68-8821-4e3b-ad69-96e592125bf8 req-d565edf3-27a9-4d7c-8d8d-956963ab5f3a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032220 May 13 13:51:28.699180 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 202/400] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:51:28.735763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:28.744519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1dcc3711-eea9-42ac-9f7e-ee3206f94054 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1497 microversion: 2.1 time: 0.278286 May 13 13:51:28.745366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 199/401] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:28 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:28.991491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:28.992184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:28.999184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:28.999632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:29.000398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:29.000837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:29.143848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:29.151965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9fe2dd14-1338-4ef4-93ac-16b60a35b2ff tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.164746 May 13 13:51:29.152605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 203/402] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:28 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:29.614222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:29.614829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:29.623221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:29.623991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:29.624751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:29.625540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:29.691256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:29.712807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-62e38969-189c-4eac-afec-234794c8768d tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1346 microversion: 2.1 time: 0.090352 May 13 13:51:29.712807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 200/403] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:29 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:30.137392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:30.137940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:30.144562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.145009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.146424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.146675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.169019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:30.169877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:30.176832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.177343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.178148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.178583 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.188041 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:51:30.286850 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-813bfb06-c348-484c-bf63-1dcfcd1ac0f9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "DELETE /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 204 len: 0 microversion: 2.1 time: 0.155298 May 13 13:51:30.290826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 204/404] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:51:30 2022] DELETE /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:51:30.297039 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:30.297912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:30.303787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.304190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.304967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.305428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.327112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:30.335224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5c528469-6451-4617-a83a-282fe63ff34c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.170127 May 13 13:51:30.335801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 201/405] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:30 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:30.444644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:30.452641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-678c44b9-9a54-4bb0-9ff1-b54df7d4ff66 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1503 microversion: 2.1 time: 0.160267 May 13 13:51:30.453201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 205/406] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:30 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:30.723999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:30.724966 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:30.733252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.733703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.734523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.734962 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.767484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:30.767954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:30.768498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lazy-loading 'fault' on Instance uuid 5fe8806f-ef13-4621-9dea-850cdab53624 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:51:30.816029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:30.824467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-39315cd8-ec79-4169-aa9f-f73c8cec01a2 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1351 microversion: 2.1 time: 0.107086 May 13 13:51:30.825045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 202/407] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:30 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:31.354962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:31.355549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:31.362959 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.363465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.364320 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.364809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.472578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:31.473448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:31.480958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.481413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.482222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.482662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.505057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:31.513365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-60440590-2c39-483a-9100-9fa359ce7286 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.164283 May 13 13:51:31.513939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 206/408] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:31 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:31.616933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:31.624843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2ceaaefb-7973-4967-a8b8-d5d2602aa001 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1503 microversion: 2.1 time: 0.158488 May 13 13:51:31.625400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 203/409] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:31 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:31.841766 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:31.842328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:31.848539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.848977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.849742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.850216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.882000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:31.882473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:31.882928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lazy-loading 'fault' on Instance uuid 5fe8806f-ef13-4621-9dea-850cdab53624 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:51:31.927212 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:31.935733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-259cecb7-8517-44a2-b636-b60376d1003e tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1351 microversion: 2.1 time: 0.097869 May 13 13:51:31.936294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 207/410] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:31 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:32.530736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:32.531332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:32.537635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.538105 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:32.538865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.539292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:32.641632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:32.642269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:32.649363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.650889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:32.651947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.652454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:32.682175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:32.690568 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ce195dc6-f542-4d9b-bbe6-9788a35676e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.163608 May 13 13:51:32.691138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 204/411] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:32 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:32.789375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:32.796754 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b1d3a366-24da-4c1d-a28d-21bf4e07d407 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1503 microversion: 2.1 time: 0.159263 May 13 13:51:32.797318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 208/412] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:32 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:32.956089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:32.956706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:32.964008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.964683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:32.966314 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:32.967283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.026934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.027515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.028078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lazy-loading 'fault' on Instance uuid 5fe8806f-ef13-4621-9dea-850cdab53624 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:51:33.102405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258595798e7742bbb3e34cfdd7fdeb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d6e24fd6ed4e629115e136441c159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:33.111522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ad59195c-f4ba-4e0f-895f-189d5636b0aa tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 200 len: 1351 microversion: 2.1 time: 0.161540 May 13 13:51:33.122072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 205/413] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:32 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:33.504555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-e889f532-58f9-43d7-bb59-d5b98b5ea273 req-4b3084af-367b-4643-af40-d92f0245124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510e2cc5-610f-4a58-aa08-914710d5b808", "name": "network-vif-deleted", "tag": "5731f2a6-40d5-4e6a-a05c-b13bf5a11a93"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:33.512647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-e889f532-58f9-43d7-bb59-d5b98b5ea273 req-4b3084af-367b-4643-af40-d92f0245124e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.513089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-e889f532-58f9-43d7-bb59-d5b98b5ea273 req-4b3084af-367b-4643-af40-d92f0245124e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.523945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-e889f532-58f9-43d7-bb59-d5b98b5ea273 req-4b3084af-367b-4643-af40-d92f0245124e service nova] Creating event network-vif-deleted:5731f2a6-40d5-4e6a-a05c-b13bf5a11a93 for instance 510e2cc5-610f-4a58-aa08-914710d5b808 on hv-cinder-79578 May 13 13:51:33.529544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-e889f532-58f9-43d7-bb59-d5b98b5ea273 req-4b3084af-367b-4643-af40-d92f0245124e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028675 May 13 13:51:33.530388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 209/414] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:33.709381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:33.710658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:33.723107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.723439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.724410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.725046 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.815678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:33.817873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:33.825421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.826562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.827469 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:33.827915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:33.888843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:33.896333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6c0b9869-e61c-481c-b56d-a1012a387782 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.192377 May 13 13:51:33.897209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 206/415] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:33 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:33.919087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:33.926446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-965fc789-e72a-46b7-b72a-8c01daeb6f2f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1461 microversion: 2.1 time: 0.116280 May 13 13:51:33.927195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 210/416] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:33 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1461 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:34.128401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:34.129215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:34.135706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.136348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.137170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.137596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.152266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] HTTP exception thrown: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Request method failure captured: May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 HTTP/1.1 May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHWKZxv1texbRdsnYwadbuFnSremyklXi3wOczGIZd4f7WqA9H0MKPXxKGtRqgimcn3DQPSglHi9MYQqEyJwmqAfNjOGx4A8UUQXJxAaIQe09YJXfWDvNw6eOC_vVCS9NOHOJBYPtK9RRl3P1ma8UH9Tssc5HAZL5uIlC_6GL6IvDw May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:51:34.157433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 258595798e7742bbb3e34cfdd7fdeb7c May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.159032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '5fe8806f-ef13-4621-9dea-850cdab53624'} May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:51:34.159931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.161595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:34.163661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Returning 404 to user: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:51:34.163661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b67ce11c-51a7-4df3-b997-4ed2e1c0578c tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 404 len: 111 microversion: 2.1 time: 0.034595 May 13 13:51:34.163661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 207/417] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:34 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:51:34.267256 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:34.268186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:34.274469 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.274916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.276165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.276595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.289824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] HTTP exception thrown: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Request method failure captured: May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624/os-volume_attachments HTTP/1.1 May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHWKZxv1texbRdsnYwadbuFnSremyklXi3wOczGIZd4f7WqA9H0MKPXxKGtRqgimcn3DQPSglHi9MYQqEyJwmqAfNjOGx4A8UUQXJxAaIQe09YJXfWDvNw6eOC_vVCS9NOHOJBYPtK9RRl3P1ma8UH9Tssc5HAZL5uIlC_6GL6IvDw May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 13:51:34.298509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 258595798e7742bbb3e34cfdd7fdeb7c May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.299792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'server_id': '5fe8806f-ef13-4621-9dea-850cdab53624'} May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:51:34.300471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:34.301540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:34.302709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Returning 404 to user: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:51:34.302709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ca89d5ac-6b8b-4112-a6fa-48dd6ffd0979 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036837 May 13 13:51:34.302709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 211/418] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 13:51:34 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:51:34.913739 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:34.914420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:34.921283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.921796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.922879 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.923515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.947339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:34.951016 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:34.960915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.961460 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:34.963148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:34.963781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:35.045093 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:35.053958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cfa95e5c-d54c-44d8-9ff0-bd7fa8675bf1 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 200 len: 1461 microversion: 2.1 time: 0.113480 May 13 13:51:35.054639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 212/419] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:34 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:35.095759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:35.103736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-26927e21-eb4e-4e96-aed3-ddf9f2465af1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.194736 May 13 13:51:35.104307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 208/420] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:34 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:35.535085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:35.535850 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:35.547488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:35.548128 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:35.549589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:35.551176 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:35.569074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] HTTP exception thrown: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Request method failure captured: May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 HTTP/1.1 May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHWKZxv1texbRdsnYwadbuFnSremyklXi3wOczGIZd4f7WqA9H0MKPXxKGtRqgimcn3DQPSglHi9MYQqEyJwmqAfNjOGx4A8UUQXJxAaIQe09YJXfWDvNw6eOC_vVCS9NOHOJBYPtK9RRl3P1ma8UH9Tssc5HAZL5uIlC_6GL6IvDw May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 13:51:35.571502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 258595798e7742bbb3e34cfdd7fdeb7c May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.572892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '5fe8806f-ef13-4621-9dea-850cdab53624'} May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:51:35.573672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.574917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:35.576196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Returning 404 to user: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:51:35.576196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d26cba84-7776-4f21-b001-be1e553fe1f8 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 404 len: 111 microversion: 2.1 time: 0.045120 May 13 13:51:35.576196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 213/421] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:51:35 2022] DELETE /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:51:35.581550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:35.582421 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] [instance: 5fe8806f-ef13-4621-9dea-850cdab53624] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:35.588974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:35.589501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:35.590327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:35.590768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:35.610996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] HTTP exception thrown: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Request method failure captured: May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 HTTP/1.1 May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHWKZxv1texbRdsnYwadbuFnSremyklXi3wOczGIZd4f7WqA9H0MKPXxKGtRqgimcn3DQPSglHi9MYQqEyJwmqAfNjOGx4A8UUQXJxAaIQe09YJXfWDvNw6eOC_vVCS9NOHOJBYPtK9RRl3P1ma8UH9Tssc5HAZL5uIlC_6GL6IvDw May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:51:35.614002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/45d6e24fd6ed4e629115e136441c159f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 45d6e24fd6ed4e629115e136441c159f May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-DeleteServersTestJSON-1165831529 May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 258595798e7742bbb3e34cfdd7fdeb7c May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-DeleteServersTestJSON-1165831529-project May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.615316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '5fe8806f-ef13-4621-9dea-850cdab53624'} May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:51:35.616123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. May 13 13:51:35.617346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:51:35.618978 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] Returning 404 to user: Instance 5fe8806f-ef13-4621-9dea-850cdab53624 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:51:35.619964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e3e6146c-4f23-4688-9ae2-713736deb134 tempest-DeleteServersTestJSON-1165831529 tempest-DeleteServersTestJSON-1165831529-project] 10.222.0.24 "GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624" status: 404 len: 111 microversion: 2.1 time: 0.042214 May 13 13:51:35.620543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 209/422] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:35 2022] GET /compute/v2.1/servers/5fe8806f-ef13-4621-9dea-850cdab53624 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:51:36.072541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:36.073227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: 510e2cc5-610f-4a58-aa08-914710d5b808] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:36.084138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.084534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:36.085333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.085762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:36.106309 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] HTTP exception thrown: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Request method failure captured: May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 HTTP/1.1 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmIwr1ZSwVuOByu-nYy5v9ideifzFNHQvbxNXXHuPPjFEBFnjnCSxyrgIpTi0Vu4072Bk5e66-cURdlfponXG0DchogcyBLk7J_u6vddLWDuavMsG5t7u3fT8w1fHHg7tN4WYN5mS5ad6-sEHikWk2ZYAySzige3669r8KFZnHYlPyE May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 394c59ac8c644012b31e7e39c8d49c98 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesActionsTest-815993046 May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 13:51:36.109020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesActionsTest-815993046 May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 394c59ac8c644012b31e7e39c8d49c98 May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesActionsTest-815993046 May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesActionsTest-815993046-project May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 55015ad2822f43bda0ebc0ba93d3827d May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesActionsTest-815993046-project May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. May 13 13:51:36.110554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '510e2cc5-610f-4a58-aa08-914710d5b808'} May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:51:36.111389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. May 13 13:51:36.112613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:51:36.113584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Returning 404 to user: Instance 510e2cc5-610f-4a58-aa08-914710d5b808 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:51:36.113584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f37449a0-22b4-4b6d-8bb7-e11a397b55a4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808" status: 404 len: 111 microversion: 2.1 time: 0.045777 May 13 13:51:36.131401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 214/423] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:36 2022] GET /compute/v2.1/servers/510e2cc5-610f-4a58-aa08-914710d5b808 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:51:36.131730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:36.131730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:36.131730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.131730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:36.132746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.132746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:36.264572 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-675834307", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "networks": [{"uuid": "01225bc8-2a83-4ab7-a40f-c7a81d4023f3"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:36.344687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] validate_networks() for [('01225bc8-2a83-4ab7-a40f-c7a81d4023f3', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:51:36.357606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:36.373116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-09b484a5-56dc-41b6-9937-0ed4a38bb9e8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.251253 May 13 13:51:36.374011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 210/424] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:36 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:36.970390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:51:36.971070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:51:36.971792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:51:36.972374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:51:36.972974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:51:36.983555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.984184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:36.985028 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:36.985465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:37.015168 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Getting quotas for project 394c59ac8c644012b31e7e39c8d49c98. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:51:37.020214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Getting quotas for user 55015ad2822f43bda0ebc0ba93d3827d and project 394c59ac8c644012b31e7e39c8d49c98. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:51:37.043302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:51:37.046446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:51:37.136413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-06f1d4ab-a3ed-4889-9296-09f5cc0428f5 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878437 May 13 13:51:37.138508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 215/425] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:51:37.148422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8e0ef891-4231-4188-b43e-8a939d1f0636 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:37.149164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8e0ef891-4231-4188-b43e-8a939d1f0636 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:37.255185 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8e0ef891-4231-4188-b43e-8a939d1f0636 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:37.266388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8e0ef891-4231-4188-b43e-8a939d1f0636 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1213 microversion: 2.1 time: 0.121663 May 13 13:51:37.276064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 211/426] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:37 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:37.391474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:37.392222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:37.399746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:37.400903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:37.402518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:37.403326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:37.574689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:37.600283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1d2e4aea-72e9-4214-ac54-b9d3d389243c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1522 microversion: 2.1 time: 0.213502 May 13 13:51:37.601983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 216/427] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:37 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:38.284310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:38.285487 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:38.299650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:38.300555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:38.301548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:38.302765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:38.463913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:38.473166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3c46d4fa-3bde-47e8-b0ac-51921436cf41 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1217 microversion: 2.1 time: 0.193069 May 13 13:51:38.473711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 212/428] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:38 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:38.621760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:38.623163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:38.637594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:38.639422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:38.640540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:38.642868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:39.022220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:39.030009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c98afe0e-b56b-4ca1-924c-af711c32d617 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1502 microversion: 2.1 time: 0.413315 May 13 13:51:39.030611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 217/429] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:38 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1502 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:39.054816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:39.056786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:39.073433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:39.073777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:39.076381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:39.077580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:39.391502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:39.402944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7beeab20-6ef1-4789-a1f2-7a4e5fc171fa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1517 microversion: 2.1 time: 0.352975 May 13 13:51:39.403556 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 213/430] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:39 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:39.490494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:39.491242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:39.504948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:39.505407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:39.506252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:39.506695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:39.624758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:39.633253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-542d0ba9-ae57-4ed8-a794-d9fb1f66bf31 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1271 microversion: 2.1 time: 0.146379 May 13 13:51:39.638443 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 218/431] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:39 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:40.670736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:40.671367 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:40.698675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:40.699316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:40.700160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:40.701006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:41.105815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:41.114674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ca35503b-d4d5-481a-a005-30ae45e92cd0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.460893 May 13 13:51:41.126864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 214/432] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:40 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:42.135878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:42.137091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:42.151317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.151769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.153309 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.153906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.199245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:42.200272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:42.207497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.207772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.208781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.209222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.241835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lazy-loading 'flavor' on Instance uuid 361ca01b-bda3-4060-a318-72a052700b32 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:51:42.332059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:42.346318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cd6821c2-456b-4cec-9028-20bfdbaa8bc3 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.215617 May 13 13:51:42.359938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 219/433] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:42 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:42.370608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-f52c39f7-30b3-486c-a80f-bf30cdc1cd7e req-a7e9ba17-f798-4528-9920-2708d8fad10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64e31a8-d3db-4aff-8aa8-bdc8b76e6639", "tag": "a1aa15a3-c116-4b1a-acef-8edb60ca8161"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:42.381639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4249b961-ba83-442e-9205-db44a58f5008 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/action" status: 200 len: 32 microversion: 2.1 time: 0.186591 May 13 13:51:42.382354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 215/434] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:51:42 2022] POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:51:42.393123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:42.393875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:42.401723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.402213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.403086 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-f52c39f7-30b3-486c-a80f-bf30cdc1cd7e req-a7e9ba17-f798-4528-9920-2708d8fad10d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.403237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:42.403557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-f52c39f7-30b3-486c-a80f-bf30cdc1cd7e req-a7e9ba17-f798-4528-9920-2708d8fad10d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.403732 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:42.425580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-f52c39f7-30b3-486c-a80f-bf30cdc1cd7e req-a7e9ba17-f798-4528-9920-2708d8fad10d service nova] Creating event network-changed:a1aa15a3-c116-4b1a-acef-8edb60ca8161 for instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 on hv-cinder-79578 May 13 13:51:42.435632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-f52c39f7-30b3-486c-a80f-bf30cdc1cd7e req-a7e9ba17-f798-4528-9920-2708d8fad10d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073807 May 13 13:51:42.436830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 220/435] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:42.698441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:42.708172 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-73c94b4b-031d-4e2c-b63e-8646ffba70ba tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.319231 May 13 13:51:42.708759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 216/436] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:42 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:43.365173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "213011d5-85f2-48ae-8834-90460cefae51", "device": "/dev/sdb"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:43.367165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:43.368153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:43.368508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:43.376099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.376718 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.377070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:43.377187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:43.378169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.378807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:43.379049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.379501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:43.713001 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:43.729707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-95f7d722-3332-437f-bc05-576a916993a9 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.366794 May 13 13:51:43.738728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 221/437] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:43 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:43.742367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:43.743346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:43.752788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.753628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:43.754672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:43.755351 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:44.044952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:44.059331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8e95a7ba-f6a7-4a50-9f25-b01515f44c05 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.325297 May 13 13:51:44.060958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 222/438] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:43 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:44.756002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:44.756707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:44.768947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:44.770524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:44.771369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:44.773512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:45.013543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:45.021581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ab4a33d5-08a4-4f47-8c31-5d6a7a233657 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.270043 May 13 13:51:45.022257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 223/439] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:44 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:45.077023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:45.077649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:45.088032 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:45.088524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:45.089343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:45.089782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:45.354115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:45.363392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b4ab03b5-5573-4f55-a1a8-5767be076e3e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.290155 May 13 13:51:45.376415 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 224/440] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:45 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:46.043328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:46.043328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:46.064063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:46.064449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:46.065632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:46.066127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:46.330669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:46.340292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7c6220c4-ef6d-45b5-bf2a-b3b76797d0dc tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.304914 May 13 13:51:46.340900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 225/441] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:46 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:46.381047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:46.381653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:46.390522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:46.390967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:46.392144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:46.392869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:46.595116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:46.603562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a2d701a4-d559-400b-91f1-e02c3bfaf4c2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.226251 May 13 13:51:46.616657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 226/442] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:46 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:46.874764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ea0102ce-9af6-488f-bcd8-0a832ae31ced tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "POST /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.512163 May 13 13:51:46.881828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 217/443] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:51:43 2022] POST /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7/os-volume_attachments => generated 194 bytes in 3521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:47.356728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:47.357340 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:47.367930 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:47.368442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:47.369479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:47.370075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:47.624483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:47.625546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:47.643148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:47.643601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:47.644448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:47.647348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:48.051654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:48.063554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ccbf0c88-872d-4da1-a898-9c2143e86ff5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.445306 May 13 13:51:48.064141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 218/444] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:47 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:48.331180 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:48.343250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1e7f5798-ba4c-484e-b528-60fb898dd930 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.989178 May 13 13:51:48.345814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 227/445] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:47 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:49.082887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:49.084179 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:49.093765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:49.097893 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:49.099023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:49.099792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:49.295949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:49.304269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e8003564-9538-46df-b1f7-edf646a887b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.225534 May 13 13:51:49.304852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 219/446] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:49 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:49.371374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:49.372482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:49.378756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:49.379214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:49.379971 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:49.380394 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:49.620502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:49.641226 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a25acc84-985a-443f-a462-3c65ab2526ae tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.284173 May 13 13:51:49.646315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 228/447] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:49 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:50.323981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:50.324835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:50.331982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:50.332653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:50.333586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:50.334222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:50.494877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:50.497570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a2fe43f6-042d-47e4-a82c-50981d60339c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Action: 'create', calling method: .version_select at 0x7ff1541f8700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1285115109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTonAa2epBPoxkVjyoaWeKjrTxxPTUinsRk29TnzRvQZWDfZA8SZipdHTNCH0KAPATSEovtubCTK2KXq14GAHA29LsMW2TsO6HwEqo9ohcx1oQD8W1ow0wVop/oTGsecA=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:50.505303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7ec1bf67-74f6-46d1-8ba0-e92e06b76a5b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.186288 May 13 13:51:50.515059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 229/448] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:50 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:50.515300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-a2fe43f6-042d-47e4-a82c-50981d60339c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for project 5f52886f21f64392889649d64be8b3d3. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:51:50.519063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-a2fe43f6-042d-47e4-a82c-50981d60339c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for user 1554793dc7934f9889da636263301ecf and project 5f52886f21f64392889649d64be8b3d3. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:51:50.543237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a2fe43f6-042d-47e4-a82c-50981d60339c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.274369 May 13 13:51:50.543933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 220/449] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:51:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:50.630694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-73db8c1e-f529-4386-8342-03864456c056 req-22f426de-a7fe-47eb-bdcb-8932c6a66e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64e31a8-d3db-4aff-8aa8-bdc8b76e6639", "name": "network-vif-plugged", "status": "completed", "tag": "a1aa15a3-c116-4b1a-acef-8edb60ca8161"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:51:50.640821 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-73db8c1e-f529-4386-8342-03864456c056 req-22f426de-a7fe-47eb-bdcb-8932c6a66e50 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:50.641274 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-73db8c1e-f529-4386-8342-03864456c056 req-22f426de-a7fe-47eb-bdcb-8932c6a66e50 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:50.658956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-73db8c1e-f529-4386-8342-03864456c056 req-22f426de-a7fe-47eb-bdcb-8932c6a66e50 service nova] Creating event network-vif-plugged:a1aa15a3-c116-4b1a-acef-8edb60ca8161 for instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 on hv-cinder-79578 May 13 13:51:50.659160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:50.659918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:50.668613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:50.670207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-73db8c1e-f529-4386-8342-03864456c056 req-22f426de-a7fe-47eb-bdcb-8932c6a66e50 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039781 May 13 13:51:50.671245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 230/450] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:51:50.673146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:50.674028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:50.678084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:50.882816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:50.893695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1e107c2e-4310-40ac-b938-2dbcc6f36b12 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.239177 May 13 13:51:50.894315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 221/451] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:50 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:51.523408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:51.524692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:51.532600 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:51.533275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:51.534128 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:51.534626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:51.676323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:51.684905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3593d036-92d4-4736-8f74-5c7527c8b1d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.165795 May 13 13:51:51.685444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 231/452] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:51 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:51.910904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:51.911511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:51.918745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:51.919414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:51.920350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:51.920920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:52.061104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:52.068373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-228a5838-ddd3-471c-8f15-bd6590865f4d tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.161207 May 13 13:51:52.068934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 222/453] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:51 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:52.703798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:52.705357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:52.720027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:52.720794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:52.721898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:52.722621 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:52.908265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:52.917555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-99e50e06-776c-4409-934a-d4f036286574 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.217605 May 13 13:51:52.929017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 232/454] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:52 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:53.085354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:53.086091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:53.103544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:53.104539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:53.105914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:53.106593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:53.331883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:53.340701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-04e5d1ed-8a90-4a19-93cb-e0a74dc99e1c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1313 microversion: 2.1 time: 0.259660 May 13 13:51:53.341299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 223/455] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:53 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:53.936948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:53.937639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:53.949152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:53.949805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:53.950635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:53.951074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:54.094125 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:54.101807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cf62cf83-4826-414a-8ca9-47f9e9739775 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.169198 May 13 13:51:54.103073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 233/456] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:53 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:54.358710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:54.359457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:54.366299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:54.366990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:54.368037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:54.368470 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:54.534096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:54.540833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68074645-da08-4745-8d1d-f00068337b5a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1498 microversion: 2.1 time: 0.186485 May 13 13:51:54.541789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 224/457] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:54 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:55.120533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:55.121294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:55.127492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.128058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.128898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.129529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.143113 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:55.144602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:55.152772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.153566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.154925 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.155557 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.182637 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:51:55.289905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6e6dea21-2897-428a-9464-3d7ed4ede8f0 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 204 len: 0 microversion: 2.1 time: 0.150807 May 13 13:51:55.290825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 225/458] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:51:55 2022] DELETE /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:51:55.299551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:55.300336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:55.306650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.307176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.308020 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:55.308519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:55.316446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:55.326513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0e04f437-e937-4921-98f4-057e1d685a1b tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.210370 May 13 13:51:55.327562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 234/459] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:55 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:55.464724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:55.472409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6feabe76-c0ca-4b49-9073-f48bd40ebd93 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.177005 May 13 13:51:55.472982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 226/460] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:55 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:51:56.343300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:56.343903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:56.349913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:56.350670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:56.351768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:56.352682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:56.493336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:56.493943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:56.500121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:56.500574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:56.500672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:56.501340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:56.501773 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:56.513793 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6322a00d-d9d5-4cc9-a75b-a6de25085fb1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.174413 May 13 13:51:56.514954 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 235/461] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:56 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:56.640237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:56.647791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8547181d-b42b-4e60-8185-e63fddc4c5eb tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.161512 May 13 13:51:56.648351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 227/462] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:56 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:57.532000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:57.532639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:57.538898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:57.539337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:57.540161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:57.540588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:57.665184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:57.665808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:57.674292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:57.674422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:57.674747 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:57.679064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:57.679064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:57.683111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-21ce29df-ef4c-4581-bee5-f82bef59cb8a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.154968 May 13 13:51:57.683686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 236/463] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:57 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:57.808522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:57.815923 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5a7eee1d-72f9-49ea-9048-5063c5b32bb4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.155103 May 13 13:51:57.816480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 228/464] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:57 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:58.701483 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:58.702133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:58.710757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:58.710757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:58.710757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:58.710757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:58.833496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:58.834242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:58.842083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:58.842638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:58.843573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:58.844075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:58.874846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:58.883048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-04d9d2dc-c0ce-4380-aaf2-f17a2b89a80e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.185176 May 13 13:51:58.884717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 237/465] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:58 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:58.992243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:51:59.000695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8e84c8fc-b124-4e90-b252-4b318975e32c tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.171319 May 13 13:51:59.001269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 229/466] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:58 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:51:59.901056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:51:59.901619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:51:59.907800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:59.908251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:51:59.909019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:51:59.909424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:00.016851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:00.017545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:00.024343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:00.024852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:00.025938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:00.026428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:00.083524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:00.093538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e38c5763-2fef-4657-8470-7e5a459f506c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.196561 May 13 13:52:00.095175 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 238/467] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:51:59 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:00.191286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:00.199677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-65990563-5d12-4b48-9877-a74607629fd6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.186561 May 13 13:52:00.200252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 230/468] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:00 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:01.112421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:01.113025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:01.119070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:01.119617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:01.120463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:01.120895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:01.216504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:01.217801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:01.224658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:01.225405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:01.226611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:01.228042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:01.257720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:01.267498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ee230bec-d1f9-467e-9bae-a4f66f8a4bc8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.158817 May 13 13:52:01.268382 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 239/469] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:01 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:01.470274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:01.477922 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c039b376-e8e9-45e0-b606-ca40d472cfc7 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.265707 May 13 13:52:01.478563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 231/470] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:01 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:02.285199 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:02.285819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:02.291915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:02.292346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:02.293110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:02.293547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:02.428928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:02.437416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-631ee14f-a7f1-4175-bd17-19f2771e6d4f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.156097 May 13 13:52:02.438073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 240/471] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:02 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:02.495678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:02.496302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:02.502430 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:02.502883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:02.503654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:02.504107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:02.639014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:02.650083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ed8473bf-8ad7-4030-8882-064296a8030b tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.159097 May 13 13:52:02.651010 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 232/472] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:02 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:03.455014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:03.455596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:03.462246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:03.462709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:03.463480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:03.463923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:03.594310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:03.605127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f7963f88-6acb-4a7d-8886-b637298e9479 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.154006 May 13 13:52:03.605692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 241/473] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:03 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:03.669970 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:03.670656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:03.679495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:03.680236 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:03.681249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:03.681824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:03.819914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:03.828039 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-33244e78-0eb7-4f3d-92f3-bf950c902dee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.163359 May 13 13:52:03.828607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 233/474] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:03 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:04.623481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:04.624090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:04.631462 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:04.631909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:04.632659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:04.633096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:04.773825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:04.783188 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-59baa135-90c8-4a2f-bedb-dc688f079d10 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.164368 May 13 13:52:04.783734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 242/475] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:04 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:04.844846 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:04.845411 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:04.852235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:04.852867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:04.853745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:04.854327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:04.999535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:05.007243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0a27a06b-8aec-4841-b6f9-93baaffc7310 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.166252 May 13 13:52:05.007813 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 234/476] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:04 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:05.803380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:05.803981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:05.810958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:05.811381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:05.812251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:05.812622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:05.947267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:05.954683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1b968490-c99d-404e-9370-60ecc7bf368e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.155232 May 13 13:52:05.955227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 243/477] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:05 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:06.029031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:06.030006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:06.040614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:06.041058 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:06.041814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:06.042276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:06.184612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:06.196137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-373d2d66-2740-4f4a-a2f7-76ce91950811 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.173739 May 13 13:52:06.196865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 235/478] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:06 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:06.971790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:06.972361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:06.978737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:06.979177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:06.979928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:06.980390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:07.113293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:07.121728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1c613ad0-2aa0-4f57-af46-65d1ed51bf0e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.153730 May 13 13:52:07.130097 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 244/479] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:06 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:07.213883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:07.214545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:07.221163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:07.221638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:07.222498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:07.222934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:07.357442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:07.365354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-93dc5bab-213e-48b2-ad9e-d399554ab8ee tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.155448 May 13 13:52:07.365882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 236/480] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:07 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:08.141778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:08.142685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:08.152074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:08.152702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:08.153813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:08.154503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:08.298685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:08.310370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8c1e9a63-6243-45c3-a471-56b509793499 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.173755 May 13 13:52:08.311084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 245/481] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:08 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:08.382484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:08.383096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:08.389975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:08.390465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:08.391240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:08.391674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:08.528964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:08.537116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-dbfe750a-f1ca-4b72-a6c4-7f041d9ceb03 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.158494 May 13 13:52:08.537687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 237/482] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:08 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:09.331526 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:09.332124 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:09.338384 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:09.338824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:09.339576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:09.339999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:09.475671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:09.483977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2f766ddb-4646-44b9-af43-7cc722b108b5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.156365 May 13 13:52:09.484514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 246/483] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:09 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:09.554861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:09.555453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:09.562952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:09.563406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:09.564210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:09.564656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:09.705115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:09.713606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d85a9e0e-5012-4ec4-ba1d-65da68459fc6 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.162531 May 13 13:52:09.714441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 238/484] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:09 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:10.502298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:10.502980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:10.514271 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:10.514720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:10.515503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:10.515942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:10.676688 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:10.685552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4391ac52-7b23-4fd3-b437-87223ba9a438 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.187124 May 13 13:52:10.686169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 247/485] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:10 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:10.737142 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:10.737725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:10.746019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:10.746510 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:10.747298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:10.747740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:10.887524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:10.896414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-180e6c5d-cad3-4dd9-a937-9146276f0f13 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.163732 May 13 13:52:10.897050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 239/486] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:10 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:11.259673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-39fe6c47-76de-4676-af96-c35a75fbe7b7 req-6f0ee6c7-91b0-4fc2-8368-738ea804afd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64e31a8-d3db-4aff-8aa8-bdc8b76e6639", "name": "network-vif-unplugged", "status": "completed", "tag": "a1aa15a3-c116-4b1a-acef-8edb60ca8161"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:11.268325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-39fe6c47-76de-4676-af96-c35a75fbe7b7 req-6f0ee6c7-91b0-4fc2-8368-738ea804afd3 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:11.268923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-39fe6c47-76de-4676-af96-c35a75fbe7b7 req-6f0ee6c7-91b0-4fc2-8368-738ea804afd3 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:11.282490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-39fe6c47-76de-4676-af96-c35a75fbe7b7 req-6f0ee6c7-91b0-4fc2-8368-738ea804afd3 service nova] Creating event network-vif-unplugged:a1aa15a3-c116-4b1a-acef-8edb60ca8161 for instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 on hv-cinder-79578 May 13 13:52:11.288036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-39fe6c47-76de-4676-af96-c35a75fbe7b7 req-6f0ee6c7-91b0-4fc2-8368-738ea804afd3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032122 May 13 13:52:11.288634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 248/487] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:52:11.703641 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:11.704242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:11.711571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:11.711571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:11.712475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:11.713139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:11.858555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:11.866650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5169b85d-ee5a-4922-b285-f6a07a16d435 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.167005 May 13 13:52:11.867209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 240/488] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:11 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:11.915278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:11.916037 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:11.922849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:11.923353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:11.924181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:11.924607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:12.058739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:12.067605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-70091687-7b87-4c89-bb47-fabd27f0c369 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.156844 May 13 13:52:12.068230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 249/489] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:11 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:12.886876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:12.887445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:12.894342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:12.894793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:12.895560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:12.895990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:13.036018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:13.044730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5446042b-3a8b-4285-854a-0f98f4e8a117 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.163608 May 13 13:52:13.045380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 241/490] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:12 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:13.085005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:13.086454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:13.092960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:13.093407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:13.094212 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:13.094641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:13.264164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:13.273325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2d21eac9-92e6-4056-9856-a1a97cbd3dab tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1504 microversion: 2.1 time: 0.192305 May 13 13:52:13.274418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 250/491] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:13 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:13.655337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-4de0e71b-b8c8-431c-9bfa-e09bc2440e85 req-c0ee639c-6ffb-4082-8d44-85a74ba633ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64e31a8-d3db-4aff-8aa8-bdc8b76e6639", "name": "network-vif-deleted", "tag": "a1aa15a3-c116-4b1a-acef-8edb60ca8161"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:13.663698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4de0e71b-b8c8-431c-9bfa-e09bc2440e85 req-c0ee639c-6ffb-4082-8d44-85a74ba633ce service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:13.664132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4de0e71b-b8c8-431c-9bfa-e09bc2440e85 req-c0ee639c-6ffb-4082-8d44-85a74ba633ce service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:13.675547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-4de0e71b-b8c8-431c-9bfa-e09bc2440e85 req-c0ee639c-6ffb-4082-8d44-85a74ba633ce service nova] Creating event network-vif-deleted:a1aa15a3-c116-4b1a-acef-8edb60ca8161 for instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 on hv-cinder-79578 May 13 13:52:13.680817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-4de0e71b-b8c8-431c-9bfa-e09bc2440e85 req-c0ee639c-6ffb-4082-8d44-85a74ba633ce service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030258 May 13 13:52:13.681389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 242/492] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:52:14.066103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:14.066773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:14.073017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:14.073472 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:14.074339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:14.074822 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:14.207820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:14.215289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-beb2d54b-28ee-49f2-a3ba-5d258126c09c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.155527 May 13 13:52:14.215853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 251/493] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:14 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:14.298800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:14.299671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:14.310927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:14.311388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:14.312162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:14.312608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:14.376659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:14.384210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2939a9c4-3ebb-4279-b2e2-79027a8301b4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1298 microversion: 2.1 time: 0.093633 May 13 13:52:14.384765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 243/494] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:14 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:15.236136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:15.236800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:15.244259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:15.244739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:15.245584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:15.246090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:15.397438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:15.400589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:15.402098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:15.405459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-08fb27c6-657d-4e57-a485-3b6882f4298f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.175111 May 13 13:52:15.406018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 252/495] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:15 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:15.409383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:15.409839 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:15.410659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:15.411099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:15.473782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:15.482294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-30b3d7ce-b776-4f7d-90f8-b99071e8105a tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1298 microversion: 2.1 time: 0.085409 May 13 13:52:15.482891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 244/496] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:15 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:16.427563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:16.428609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:16.438245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:16.438710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:16.439487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:16.439893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:16.499405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:16.500191 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:16.506736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:16.507196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:16.507959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:16.508389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:16.571988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:16.573527 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:16.579821 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e58b261d-46eb-48e6-98f7-105129d60f7f tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1298 microversion: 2.1 time: 0.084380 May 13 13:52:16.580350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 245/497] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:16 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:16.581020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f6b937c4-8cc3-4aff-b7bd-db1f879fb037 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.160193 May 13 13:52:16.581700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 253/498] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:16 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:17.600349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:17.601589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:17.602333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:17.602755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:17.611453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:17.611905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:17.612229 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:17.612673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:17.612814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:17.613136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:17.613441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:17.613875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:17.676308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:17.683709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b6948be0-76ed-4fe3-9fb4-c32b735ad4c4 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1298 microversion: 2.1 time: 0.089245 May 13 13:52:17.684314 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 246/499] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:17 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:17.745155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:17.753294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-77042394-5f1b-4f5c-83b8-edc4caf1e377 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.157512 May 13 13:52:17.753856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 254/500] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:17 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:18.700145 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:18.701407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:18.712291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:18.712821 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:18.713646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:18.714199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:18.747938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:18.748388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:18.748837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lazy-loading 'fault' on Instance uuid c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:52:18.771524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:18.772237 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:18.780174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:18.780174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:18.780174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:18.780174 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:18.805554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:18.814179 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cabb0b9a-7c7a-43c5-8c51-ccb302390356 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1303 microversion: 2.1 time: 0.118073 May 13 13:52:18.822439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 247/501] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:18 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:18.923154 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:18.934267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-12ea9bf8-20b5-4ae3-8bd1-cb73ad68b5bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.166745 May 13 13:52:18.934992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 255/502] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:18 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:19.832629 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:19.833218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:19.839818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:19.840278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:19.841043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:19.841479 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:19.875293 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:19.875989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:19.876440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lazy-loading 'fault' on Instance uuid c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:52:19.917669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55015ad2822f43bda0ebc0ba93d3827d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c59ac8c644012b31e7e39c8d49c98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:19.925360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e77c9b73-2103-4550-b4ed-a5d3d7e3d797 tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 200 len: 1303 microversion: 2.1 time: 0.097045 May 13 13:52:19.926085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 248/503] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:19 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:19.951647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:19.952374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:19.958947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:19.959482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:19.960368 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:19.960815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.092323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:20.108133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-761e10a7-1bfb-4609-93ad-31d1462a58e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1503 microversion: 2.1 time: 0.160332 May 13 13:52:20.108744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 256/504] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:19 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:20.124676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b89b5c8d-d96a-42ff-9986-7b15755a91e7"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:20.125866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:20.131865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.132310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.133066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.133503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.155978 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] HTTP exception thrown: Cannot 'attach_volume' instance 361ca01b-bda3-4060-a318-72a052700b32 while it is in vm_state rescued May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Request method failure captured: May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/os-volume_attachments HTTP/1.1 May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 74 May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHmoYcXdpLJ0mvorCl5JvtXnQvdvSc0qcaI5DOYf55NIuNJ8Oy6IGOmr5HmQO94HqnEmCd2US9nN2h0c5MKlvfDiCH7Ht1lFA30TWE7YckEcEgOiEI_xGSE6LctKDV1baE2Ay0dNvSQfiWeikOMp886N_OE-nsmDBQWBo_Z1Bv_raQ May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:52:20.158376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f9ca490113764eba85daa6ca9fbba5f5 May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {"volumeAttachment": {"volumeId": "b89b5c8d-d96a-42ff-9986-7b15755a91e7"}} May 13 13:52:20.160063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Cannot 'attach_volume' instance 361ca01b-bda3-4060-a318-72a052700b32 while it is in vm_state rescued May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'server_id': '361ca01b-bda3-4060-a318-72a052700b32', 'body': {'volumeAttachment': {'volumeId': 'b89b5c8d-d96a-42ff-9986-7b15755a91e7'}}} May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 361ca01b-bda3-4060-a318-72a052700b32 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:52:20.160866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 361ca01b-bda3-4060-a318-72a052700b32 while it is in vm_state rescued May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:20.162164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 361ca01b-bda3-4060-a318-72a052700b32 while it is in vm_state rescued May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Returning 409 to user: Cannot 'attach_volume' instance 361ca01b-bda3-4060-a318-72a052700b32 while it is in vm_state rescued {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0bc23540-06d6-4ca6-a513-8d8bc1fde725 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039241 May 13 13:52:20.163523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 249/505] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:52:20 2022] POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:52:20.172026 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:20.172947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:20.182202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.182690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.183504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.183937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.252431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9da1f50a-b8fd-422c-8b62-652021c78760 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/action" status: 202 len: 0 microversion: 2.1 time: 0.086611 May 13 13:52:20.253005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 257/506] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:52:20 2022] POST /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:52:20.263028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:20.263679 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:20.271038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.271480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.272249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.272657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.427045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:20.436013 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7c17df62-e538-418e-9156-2364a2d22a08 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.178650 May 13 13:52:20.436602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 250/507] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:20 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:20.942608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:20.943445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] [instance: c64e31a8-d3db-4aff-8aa8-bdc8b76e6639] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:20.949812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.950356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.951121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:20.951588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:20.967559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] HTTP exception thrown: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Request method failure captured: May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 HTTP/1.1 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmIwr1ZSwVuOByu-nYy5v9ideifzFNHQvbxNXXHuPPjFEBFnjnCSxyrgIpTi0Vu4072Bk5e66-cURdlfponXG0DchogcyBLk7J_u6vddLWDuavMsG5t7u3fT8w1fHHg7tN4WYN5mS5ad6-sEHikWk2ZYAySzige3669r8KFZnHYlPyE May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 394c59ac8c644012b31e7e39c8d49c98 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesActionsTest-815993046 May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 13:52:20.969287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/394c59ac8c644012b31e7e39c8d49c98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesActionsTest-815993046 May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 394c59ac8c644012b31e7e39c8d49c98 May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesActionsTest-815993046 May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesActionsTest-815993046-project May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 55015ad2822f43bda0ebc0ba93d3827d May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesActionsTest-815993046-project May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. May 13 13:52:20.971187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'c64e31a8-d3db-4aff-8aa8-bdc8b76e6639'} May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:52:20.971967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. May 13 13:52:20.973184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 13:52:20.982767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] Returning 404 to user: Instance c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:52:20.982767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-970393ab-e41d-4d26-a07d-0ee20cb273fe tempest-VolumesActionsTest-815993046 tempest-VolumesActionsTest-815993046-project] 10.222.0.24 "GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639" status: 404 len: 111 microversion: 2.1 time: 0.032776 May 13 13:52:20.982767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 258/508] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:20 2022] GET /compute/v2.1/servers/c64e31a8-d3db-4aff-8aa8-bdc8b76e6639 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:52:21.453078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:21.453719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:21.460140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:21.460585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:21.461357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:21.461954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:21.605646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:21.614437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5de1a409-fa03-4026-b355-0ba776e68de1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.165465 May 13 13:52:21.615110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 251/509] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:21 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:22.635481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:22.636367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:22.645074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:22.645210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:22.645943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:22.646423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:22.783515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:22.791453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-04e73d0a-128d-4d06-97fc-6c5e8887e616 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.162631 May 13 13:52:22.792024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 259/510] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:22 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:23.441587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:23.442147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:23.452327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:23.452916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:23.454307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:23.454658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:23.583108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'services' on Instance uuid f888a0eb-66c0-4c4f-8340-248494490ff7 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:52:23.701286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-096481af-641a-4190-b128-05b2d73c1559 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7/os-volume_attachments/213011d5-85f2-48ae-8834-90460cefae51" status: 202 len: 0 microversion: 2.1 time: 0.265688 May 13 13:52:23.702004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 252/511] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 13:52:23 2022] DELETE /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7/os-volume_attachments/213011d5-85f2-48ae-8834-90460cefae51 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:52:23.809195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:23.809746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:23.816398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:23.816852 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:23.817599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:23.818073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:23.955442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:23.963242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-194bf4c3-60e0-4c9c-9078-f1de7a90307f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.157866 May 13 13:52:23.963802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 260/512] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:23 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:24.981816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:24.982534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:24.989505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:24.989948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:24.990820 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:24.991249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:25.358115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:25.369770 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b3115070-9a03-45b1-93ad-de3ce76422d2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.392376 May 13 13:52:25.370577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 253/513] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:24 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:26.393562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:26.394258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:26.402248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:26.402791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:26.403693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:26.404205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:26.560360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:26.568352 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6731e1bf-e6a2-43c9-a67f-18c7395ec0ef tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.181353 May 13 13:52:26.568892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 261/514] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:26 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:27.589535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:27.590562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:27.599331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:27.599776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:27.600544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:27.600981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:27.745203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:27.757135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9bb5564f-3b2d-4fa4-b2b9-4aac1b109c74 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.173770 May 13 13:52:27.757831 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 254/515] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:27 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:28.778246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:28.778893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:28.785916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:28.786400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:28.787147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:28.787596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:28.930859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:28.942272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0afa916d-2544-49e3-a5a4-38e21a60cb90 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.168350 May 13 13:52:28.942841 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 262/516] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:28 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:29.959577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:29.960148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:29.966746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:29.967187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:29.967956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:29.968354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:30.102799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:30.110120 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c273b44e-0330-4576-b5f2-75ff6a303637 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.154347 May 13 13:52:30.116466 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 255/517] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:29 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:31.127640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:31.128704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:31.135036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:31.135486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:31.136294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:31.136735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:31.280041 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:31.287898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dc513ee5-0f28-460e-86f6-019bd6725144 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1511 microversion: 2.1 time: 0.164781 May 13 13:52:31.288468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 263/518] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:31 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:32.238406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:32.239648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:32.246980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.247423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.248489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.248846 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.294433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:52:32.305101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:32.305936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:32.316983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.317742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.318558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.319014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.397547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-64f6b0b3-4a64-472b-8667-799518ebc1d7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 204 len: 0 microversion: 2.1 time: 0.162810 May 13 13:52:32.398660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 256/519] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:52:32 2022] DELETE /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:52:32.409302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:32.410007 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:32.417022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.417666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.418661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:32.419288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:32.514449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:32.522602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5c8ee195-3b6c-46f1-a18f-d342510384ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1517 microversion: 2.1 time: 0.221584 May 13 13:52:32.523167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 264/520] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:32 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:32.603275 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:32.611532 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2e2e2b2f-62e1-4d6d-ae7a-ac79c43e0721 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1512 microversion: 2.1 time: 0.208217 May 13 13:52:32.612567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 257/521] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:32 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:33.629107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:33.629747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:33.635960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:33.636402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:33.637166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:33.637598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:33.796127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:33.804551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f31408ee-bbb4-4a64-aaf8-13b4a0a933a8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1512 microversion: 2.1 time: 0.179570 May 13 13:52:33.805147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 265/522] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:33 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:34.824620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:34.826697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:34.839388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:34.839940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:34.840602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:34.841032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:35.024211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:35.033022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6c36d6ee-02a9-4673-930e-86c8de71c194 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1512 microversion: 2.1 time: 0.212247 May 13 13:52:35.033766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 258/523] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:34 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:35.829848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-4d758411-5c18-457d-be2b-39d4f2ed181d req-662580bc-1727-455e-97bd-9b4c5d58b08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f888a0eb-66c0-4c4f-8340-248494490ff7", "name": "network-vif-deleted", "tag": "9aaef1c1-82c7-49c6-a833-1a2d316410f8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:35.841651 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-4d758411-5c18-457d-be2b-39d4f2ed181d req-662580bc-1727-455e-97bd-9b4c5d58b08c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:35.842683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-4d758411-5c18-457d-be2b-39d4f2ed181d req-662580bc-1727-455e-97bd-9b4c5d58b08c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:35.869408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-4d758411-5c18-457d-be2b-39d4f2ed181d req-662580bc-1727-455e-97bd-9b4c5d58b08c service nova] Creating event network-vif-deleted:9aaef1c1-82c7-49c6-a833-1a2d316410f8 for instance f888a0eb-66c0-4c4f-8340-248494490ff7 on hv-cinder-79578 May 13 13:52:35.875105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-4d758411-5c18-457d-be2b-39d4f2ed181d req-662580bc-1727-455e-97bd-9b4c5d58b08c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053907 May 13 13:52:35.875911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 266/524] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:52:36.052184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:36.053654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:36.077944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:36.078830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:36.082856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:36.083890 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:36.131002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-063caff5-785d-4d28-8073-321ff53172d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: .version_select at 0x7ff154d303a0>, body: {"keypair": {"name": "tempest-keypair-906725682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdqGwD/OD4FcyItp2yuYaRXwXeKZnyBVeO9WpnLK5ZVWPTxohu+yPEJtFKRukkCJkWs27YzE8yfmtGwVByfGM8qpsZDRuLwMNOgh8Sjjz0xjvXV5Hm2lUkhwJzzs8Pk+A=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:36.157100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-063caff5-785d-4d28-8073-321ff53172d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:52:36.162991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:36.163745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:36.164397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'fault' on Instance uuid f888a0eb-66c0-4c4f-8340-248494490ff7 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:52:36.164539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-063caff5-785d-4d28-8073-321ff53172d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for user f9ca490113764eba85daa6ca9fbba5f5 and project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:52:36.210849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:36.212817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-063caff5-785d-4d28-8073-321ff53172d1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090789 May 13 13:52:36.213637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 267/525] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:52:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:52:36.223003 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ddcb5da6-b4aa-44b4-a0d6-d343630e77ad tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 200 len: 1307 microversion: 2.1 time: 0.176246 May 13 13:52:36.223588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 259/526] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:36 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 1307 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:36.794673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-385953961", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1285115109", "security_groups": [{"name": "tempest-secgroup-smoke-1880576344"}], "block_device_mapping_v2": [{"uuid": "0253f0d4-2d86-4405-8352-df2d841fa409", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f881359-87c3-427b-a40c-bc9875a283dd"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:37.240204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:37.240825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: f888a0eb-66c0-4c4f-8340-248494490ff7] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:37.247024 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:37.247469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:37.248240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:37.248662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:37.265885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] HTTP exception thrown: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Request method failure captured: May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 HTTP/1.1 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmIOu9kXjjJXkAiTsI3wk49Z2n9rxvhsBZAibgvJvfvXa1d8ocYTDzheWEzsSGNxL3J4gV2Yvk6U2VZX9-sbTpqIld1TgX6ppzwgnv7Fd8fDvsrU3RNWdEj-MHkRwQxyTn5Z-1LYJVJAZ0EQwZLkk2635gCC3MLycpqmwVAJ3En6540 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 79a1d6b4748a4489b8364d566debd6fd May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:52:37.268066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 79a1d6b4748a4489b8364d566debd6fd May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesSnapshotTestJSON-227579402-project May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4f9f35a812544a4584deb7276166d0d3 May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesSnapshotTestJSON-227579402-project May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. May 13 13:52:37.269452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'f888a0eb-66c0-4c4f-8340-248494490ff7'} May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:52:37.270273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. May 13 13:52:37.271465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:52:37.274025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Returning 404 to user: Instance f888a0eb-66c0-4c4f-8340-248494490ff7 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:52:37.275107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-702cfb78-aca6-499f-8c3d-357315f19836 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7" status: 404 len: 111 microversion: 2.1 time: 0.039176 May 13 13:52:37.275872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 260/527] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:37 2022] GET /compute/v2.1/servers/f888a0eb-66c0-4c4f-8340-248494490ff7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:52:37.306444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] validate_networks() for [('9f881359-87c3-427b-a40c-bc9875a283dd', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:52:37.904223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:52:37.904637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:52:37.905098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:52:37.905492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:52:37.905891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:52:37.920311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:37.921052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:37.922101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:37.924065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:37.969843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:52:37.978686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for user 1554793dc7934f9889da636263301ecf and project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:52:38.102423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:52:38.104614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0253f0d4-2d86-4405-8352-df2d841fa409',volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:52:38.304283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f3d581ea-17ef-428d-b3df-005d4cb93587 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.514298 May 13 13:52:38.307738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 268/528] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:52:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:52:38.317962 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0a299b48-9bd5-4562-bedd-3f1a672c45d7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:38.323676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0a299b48-9bd5-4562-bedd-3f1a672c45d7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:38.390647 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a299b48-9bd5-4562-bedd-3f1a672c45d7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:38.402026 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0a299b48-9bd5-4562-bedd-3f1a672c45d7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1094 microversion: 2.1 time: 0.088534 May 13 13:52:38.403253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 261/529] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:38 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:38.714759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-990511922", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "778c21a5-ff96-4fce-8d43-b8a6076c8622"}], "security_groups": [{"name": "tempest-securitygroup--507785983"}], "key_name": "tempest-keypair-906725682", "user_data": "}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:38.815111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] validate_networks() for [('778c21a5-ff96-4fce-8d43-b8a6076c8622', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:52:39.217111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:52:39.217740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:52:39.218484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:52:39.219156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:52:39.219773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:52:39.233308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:39.233890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:39.235133 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:39.235669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:39.253058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:52:39.256961 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Getting quotas for user f9ca490113764eba85daa6ca9fbba5f5 and project 2095d695f3ca4a9db0ab383b1f8f13ec. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:52:39.268370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:52:39.270555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:52:39.322162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8bf59cae-807c-4378-9c83-bf206c9eff1e tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.611780 May 13 13:52:39.322813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 269/530] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:52:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:52:39.333122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-92109224-ff23-4ab8-9683-0d59efa4c6da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:39.333849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-92109224-ff23-4ab8-9683-0d59efa4c6da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:39.389088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-92109224-ff23-4ab8-9683-0d59efa4c6da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:39.395776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-92109224-ff23-4ab8-9683-0d59efa4c6da tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1244 microversion: 2.1 time: 0.066752 May 13 13:52:39.396322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 262/531] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:39 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:39.420065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:39.420678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:39.427775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:39.428226 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:39.428993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:39.429398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:39.491815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:39.499245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e18e1270-7a2c-4994-ba1b-6cc0bed8c382 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1144 microversion: 2.1 time: 0.083704 May 13 13:52:39.508480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 270/532] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:39 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:40.413012 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:40.414312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:40.420754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:40.421198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:40.422088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:40.422688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:40.502949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:40.512611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3c68fa14-8921-47f1-bb8a-24fb3ae1ec0d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1248 microversion: 2.1 time: 0.103480 May 13 13:52:40.513984 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 263/533] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:40 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:40.524439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:40.525297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:40.532122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:40.532635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:40.533441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:40.533938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:40.606575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:40.617425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8c5be0cd-ae6e-404c-8257-acfaf8c98ac8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1144 microversion: 2.1 time: 0.105025 May 13 13:52:40.618503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 271/534] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:40 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1144 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:41.530152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:41.530936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:41.538270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:41.539067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:41.540100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:41.540741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:41.612263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:41.624712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ae67fc36-c1c9-498f-a162-07b22b44f518 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1248 microversion: 2.1 time: 0.098478 May 13 13:52:41.630949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 264/535] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:41 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1248 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:41.644582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:41.647911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:41.656542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:41.657222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:41.658281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:41.658985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:41.746880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:41.758747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4ed05ead-6a91-4f2a-b7af-f5eb1dbd4bc7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1144 microversion: 2.1 time: 0.120447 May 13 13:52:41.759547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 272/536] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:41 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1144 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:42.644669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:42.645224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:42.651792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:42.652553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:42.653588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:42.654360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:42.725407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:42.734306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cfaca50e-5c6e-4bd3-9b66-47e2fe72dd6c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1296 microversion: 2.1 time: 0.094046 May 13 13:52:42.737056 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 265/537] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:42 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:42.782659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:42.783612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:42.789873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:42.790355 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:42.791120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:42.791722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:42.854790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:42.862439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9533b4e7-0d6a-4e04-9627-28e0e6fc9744 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1192 microversion: 2.1 time: 0.083559 May 13 13:52:42.863159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 273/538] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:42 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:43.753400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:43.754349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:43.765102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:43.765677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:43.768930 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:43.769506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:43.878272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:43.885325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:43.885900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:43.893309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-704bfe27-e184-4718-aa03-2e222b6d3ec3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1302 microversion: 2.1 time: 0.139978 May 13 13:52:43.894378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 266/539] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:43 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1302 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:43.908716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:43.909284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:43.909977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:43.910762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:43.981560 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:43.993310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ea8c6090-d9eb-4806-8d86-ec194084e530 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1210 microversion: 2.1 time: 0.117617 May 13 13:52:44.002725 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 274/540] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:43 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:44.912725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:44.914148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:44.924983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:44.926961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:44.927939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:44.929822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:45.011302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:45.012684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:45.022344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:45.023171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:45.031745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:45.032497 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:45.345988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:45.354328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-552084ca-272a-4cec-a2a8-1b281b56107d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.347594 May 13 13:52:45.356038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 275/541] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:45 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:45.463075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:45.471305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1e1d68bb-7df4-4e12-aeae-66738cce4352 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.562391 May 13 13:52:45.476980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 267/542] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:44 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:46.372215 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:46.372816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:46.388195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:46.388937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:46.389979 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:46.390405 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:46.488669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:46.489279 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:46.499697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:46.500138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:46.500924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:46.506829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:46.636770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:46.644238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a0816965-38e2-4a4a-a0a3-1c07938a4999 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.275838 May 13 13:52:46.644805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 276/543] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:46 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:46.824272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:46.834299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-22660a5c-3f18-45c4-bfe6-85fd998dd730 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.349386 May 13 13:52:46.836047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 268/544] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:46 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:46.972733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-9a9e5812-fd06-4cab-a8ab-01f5a64b9209 req-cd532c09-fe7d-416c-b871-49ab0226159c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2efb78-1e20-4245-99cc-bbe58cb016d3", "tag": "194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:46.980736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-9a9e5812-fd06-4cab-a8ab-01f5a64b9209 req-cd532c09-fe7d-416c-b871-49ab0226159c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:46.981172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-9a9e5812-fd06-4cab-a8ab-01f5a64b9209 req-cd532c09-fe7d-416c-b871-49ab0226159c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:47.004365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-9a9e5812-fd06-4cab-a8ab-01f5a64b9209 req-cd532c09-fe7d-416c-b871-49ab0226159c service nova] Creating event network-changed:194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5 for instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 on hv-cinder-79578 May 13 13:52:47.022823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-9a9e5812-fd06-4cab-a8ab-01f5a64b9209 req-cd532c09-fe7d-416c-b871-49ab0226159c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053638 May 13 13:52:47.023428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 277/545] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:52:47.660991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:47.662268 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:47.671354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:47.672123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:47.673165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:47.674186 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:47.853315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:47.856039 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:47.857445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:47.873071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a8a9d7df-491d-4c72-bc67-c70305cc3a6e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.215733 May 13 13:52:47.873766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 269/546] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:47 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:47.876938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:47.877875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:47.878936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:47.879850 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:48.048709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:48.056629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9d6ad2fb-e54c-4141-9782-2fb423d8e114 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.206751 May 13 13:52:48.066894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 278/547] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:47 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:48.890399 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:48.891811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:48.899526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:48.900236 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:48.901481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:48.902121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:49.042626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-3e5f4833-0595-450d-b54c-81c5d676032b req-ee83516b-27a1-4ecc-9052-b9914367248d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:49.052886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-3e5f4833-0595-450d-b54c-81c5d676032b req-ee83516b-27a1-4ecc-9052-b9914367248d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:49.053320 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-3e5f4833-0595-450d-b54c-81c5d676032b req-ee83516b-27a1-4ecc-9052-b9914367248d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:49.077436 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:49.078211 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-3e5f4833-0595-450d-b54c-81c5d676032b req-ee83516b-27a1-4ecc-9052-b9914367248d service nova] Creating event network-changed:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:52:49.088046 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9e33d58b-7f0d-42d5-b85b-8bcc92df5ade tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.200987 May 13 13:52:49.089036 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 270/548] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:48 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:49.089882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-3e5f4833-0595-450d-b54c-81c5d676032b req-ee83516b-27a1-4ecc-9052-b9914367248d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050931 May 13 13:52:49.090779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 279/549] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:52:49.098623 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:49.099233 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:49.106103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:49.106967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:49.107906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:49.108496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:49.275595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:49.283742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2417166a-1078-4d2f-ab74-5f745bb42c2d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.192738 May 13 13:52:49.293654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 271/550] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:49 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:50.105161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:50.105842 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:50.118312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:50.118781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:50.119517 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:50.119944 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:50.300640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:50.301291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:50.309772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:50.311946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:50.312772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:50.313214 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:50.338583 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:50.348556 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a0343dc1-36d5-4e2a-a531-7dbfa280b62c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.246340 May 13 13:52:50.349731 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 280/551] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:50 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:50.625877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:50.643165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7d68befa-1348-4984-9541-aace4ce565a9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.345341 May 13 13:52:50.646070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 272/552] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:50 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:50.861014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1882812054", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "networks": [{"uuid": "021f0711-6445-4a50-99e4-3f54d3dcef88"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:50.925170 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] validate_networks() for [('021f0711-6445-4a50-99e4-3f54d3dcef88', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:52:51.129824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:52:51.130153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 13:52:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:52:51.349719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:52:51.350193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:52:51.350817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:52:51.351331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:52:51.351886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:52:51.363785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.364686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.365443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:51.366271 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.367078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.368709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:51.379285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.380113 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.381109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.381749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.391458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Getting quotas for project 79a1d6b4748a4489b8364d566debd6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:52:51.396608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Getting quotas for user 4f9f35a812544a4584deb7276166d0d3 and project 79a1d6b4748a4489b8364d566debd6fd. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:52:51.411148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:52:51.413794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:52:51.478798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dd629f32-f65b-4652-ac1c-fe3ea0c05693 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624717 May 13 13:52:51.480438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 281/553] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:52:51.491793 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-26f233dd-e19a-49f5-9f8a-449b8ae7662a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:51.492795 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-26f233dd-e19a-49f5-9f8a-449b8ae7662a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:51.580328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-26f233dd-e19a-49f5-9f8a-449b8ae7662a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:51.591049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-26f233dd-e19a-49f5-9f8a-449b8ae7662a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1219 microversion: 2.1 time: 0.104617 May 13 13:52:51.591942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 282/554] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:51 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:51.652663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:51.661531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-42ab891f-0ef4-4f01-a79e-c59240a41b2e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.300371 May 13 13:52:51.671278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:51.671278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:51.672167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 273/555] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:51 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:51.675213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.678669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.679539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:51.679993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:51.918808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:51.929625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1204866e-28d8-49a3-a585-2427919f91e9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.269632 May 13 13:52:51.930603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 283/556] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:51 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:52.608797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:52.609402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:52.616395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.616848 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:52.617646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.618109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:52.680172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:52.680716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:52.687305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.687755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:52.688007 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:52.688535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.688970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:52.695751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d8e383de-2d02-4d28-bfcd-beb4d125f827 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1223 microversion: 2.1 time: 0.090997 May 13 13:52:52.696310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 274/557] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:52 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:52.821635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:52.829214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5d980863-f42e-4ce2-918e-93715b98fc3b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.153464 May 13 13:52:52.829828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 284/558] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:52 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:52.950922 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:52.951928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:52.962452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.963197 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:52.964461 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:52.965181 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:53.103305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:53.111143 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-73a703dd-161e-4cac-9559-54156e48b10c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.166541 May 13 13:52:53.111698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 275/559] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:52 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:53.712835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:53.713428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:53.719704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:53.720145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:53.722385 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:53.722938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:53.791463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:53.800265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1a0c9fc2-c52d-4854-a22d-06ac1ce320ac tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1223 microversion: 2.1 time: 0.090707 May 13 13:52:53.801348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 285/560] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:53 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:53.853040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:53.853868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:53.862017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:53.862525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:53.863547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:53.863994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:54.015462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:54.022975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-16db6589-ebfb-4cfe-83df-59483b3a57b3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.181027 May 13 13:52:54.023531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 276/561] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:53 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:54.128871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:54.129482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:54.135896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:54.136350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:54.137155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:54.137587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:54.274600 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:54.282502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d0399cb7-0255-4c37-92cd-bfc1b23ade0c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.158007 May 13 13:52:54.283350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 286/562] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:54 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:54.821242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:54.822294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:54.831612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:54.832059 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:54.832822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:54.833261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:54.897428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:54.905435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a12185f7-7868-4f3b-b8c8-5f4ca7453b39 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1271 microversion: 2.1 time: 0.090825 May 13 13:52:54.906083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 277/563] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:54 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:55.043910 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:55.044576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:55.055563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.056150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:55.057251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.057732 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:55.299740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:55.300510 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:55.309215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.309917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:55.311048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.311637 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:55.334576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:55.342422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0f5b9073-0206-4f96-a7c1-451b4f9fa2bb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.305308 May 13 13:52:55.343821 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 287/564] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:55 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:55.451236 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:55.459098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-97a28dac-1172-479f-adf3-c6cc65dc267f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.163608 May 13 13:52:55.459582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 278/565] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:55 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:55.922720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:55.923341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:55.930314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.930765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:55.931543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:55.931977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.003115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:56.010852 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a58f391-1df8-4746-913e-c8feea7d0ac8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1277 microversion: 2.1 time: 0.092001 May 13 13:52:56.011427 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 288/566] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:55 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:56.359565 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:56.361320 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:56.368434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:56.368958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.369891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:56.370538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.383685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-652a4363-2f6d-4e0a-bbcf-19e240562f87 req-40e43844-2a85-4d06-ac7d-0f7e8e7c6cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "name": "network-vif-plugged", "status": "completed", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:56.396965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-652a4363-2f6d-4e0a-bbcf-19e240562f87 req-40e43844-2a85-4d06-ac7d-0f7e8e7c6cd7 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:56.397825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-652a4363-2f6d-4e0a-bbcf-19e240562f87 req-40e43844-2a85-4d06-ac7d-0f7e8e7c6cd7 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.415914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-652a4363-2f6d-4e0a-bbcf-19e240562f87 req-40e43844-2a85-4d06-ac7d-0f7e8e7c6cd7 service nova] Creating event network-vif-plugged:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:52:56.421230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-652a4363-2f6d-4e0a-bbcf-19e240562f87 req-40e43844-2a85-4d06-ac7d-0f7e8e7c6cd7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042753 May 13 13:52:56.422430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 289/567] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:52:56.479569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:56.480535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:56.490551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:56.490994 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.491760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:56.492183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:56.561593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:56.569814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8ae184ca-139a-4969-a504-22d7a4d9a110 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.214030 May 13 13:52:56.571843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 279/568] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:56 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:56.653724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:56.661163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0b85bf6c-98e0-467c-88ea-7249a157d698 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.188540 May 13 13:52:56.661806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 290/569] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:56 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:57.029785 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:57.030685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:57.037498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.038349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.039356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.039971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.125076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:57.137907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3e04dfc8-7bf0-458b-826c-ec60dce5f499 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1277 microversion: 2.1 time: 0.112927 May 13 13:52:57.138727 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 280/570] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:57 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:57.589228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:57.589836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:57.597720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.598573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.599573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.600219 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.678509 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:57.679520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:57.687431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.688029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.688914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:57.689602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:57.745031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:57.752996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f9f21415-6e27-4846-b906-e0d5ec3a2c8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.167862 May 13 13:52:57.753805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 291/571] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:57 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:57.907608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:57.915269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9b702885-11aa-48c9-ae01-97187dc5e0a8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.240532 May 13 13:52:57.915886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 281/572] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:57 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:58.155694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:58.156261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:58.164804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.165300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:58.166117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.166757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:58.516173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:58.524494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-88d4b1d9-c73e-4feb-9bc7-810afd09735f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.373274 May 13 13:52:58.525329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 292/573] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:58 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:58.770704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:58.771480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:58.779284 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.779958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:58.780915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.781506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:58.932876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:58.933783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:58.935213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:58.941393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.942340 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:58.942659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a0ee2b37-5b5d-4967-a876-f39bb7e3f467 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.176102 May 13 13:52:58.943451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:58.943703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 282/574] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:58 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:58.944537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:59.292717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:59.303371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8acde6e4-cfc7-4635-951b-c6aa314a81f5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1369 microversion: 2.1 time: 0.374430 May 13 13:52:59.305474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 293/575] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:58 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1369 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:52:59.383536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-4d067719-5723-4ea8-bf15-f93b3f9a6762 req-f9ee1282-dc0e-4c38-b5b0-40cab41311f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf", "tag": "900f685a-f7b0-40e2-86a8-40d9d9abcacb"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:52:59.392428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4d067719-5723-4ea8-bf15-f93b3f9a6762 req-f9ee1282-dc0e-4c38-b5b0-40cab41311f0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:59.393153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4d067719-5723-4ea8-bf15-f93b3f9a6762 req-f9ee1282-dc0e-4c38-b5b0-40cab41311f0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:59.405341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-4d067719-5723-4ea8-bf15-f93b3f9a6762 req-f9ee1282-dc0e-4c38-b5b0-40cab41311f0 service nova] Creating event network-changed:900f685a-f7b0-40e2-86a8-40d9d9abcacb for instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf on hv-cinder-79578 May 13 13:52:59.411051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-4d067719-5723-4ea8-bf15-f93b3f9a6762 req-f9ee1282-dc0e-4c38-b5b0-40cab41311f0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 May 13 13:52:59.412199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 283/576] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:52:59.543258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:59.544023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:59.551410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:59.551975 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:59.552820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:59.553317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:59.891092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:52:59.901633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-29cd3dc2-9906-4cbc-a1f0-fc1d077ce025 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.364048 May 13 13:52:59.918130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 294/577] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:59 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:52:59.970931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:52:59.973860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:52:59.988070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:59.994202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:52:59.995083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:52:59.995543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.225067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:00.233024 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-453b23e1-cbd9-433c-86ef-46d71dc37e4f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.276841 May 13 13:53:00.233673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 284/578] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:52:59 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:00.320014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:00.320983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:00.327308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.329403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.330944 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.331782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.723164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:00.744954 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4433ee1b-f2e9-481b-bcba-49bc30b4ea83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1563 microversion: 2.1 time: 0.417580 May 13 13:53:00.756960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 295/579] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:00 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1563 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:00.767205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:00.767937 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:00.784337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.788211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.789222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.791440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.898095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-85c75d77-4c78-49da-8700-173b1f68aae6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137697 May 13 13:53:00.898967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 285/580] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 13:53:00 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:00.921412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:00.922277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:00.930117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.930752 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:00.932376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:00.932987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:01.250235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:01.253005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:01.259797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:01.260540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:01.261765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:01.262812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:01.434107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:01.444128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5aeef82c-9784-43b0-8eab-15c9853dc329 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.198170 May 13 13:53:01.444971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 286/581] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:01 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:01.615122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:01.624309 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-af632153-f3ab-41c7-b519-0ad6a1b60e1f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.708192 May 13 13:53:01.625076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 296/582] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:00 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:53:02.465069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:02.465675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:02.472979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:02.473446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:02.474273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:02.474711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:02.612169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:02.620018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a26720d6-6ba3-4810-880e-304c6c410597 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.158897 May 13 13:53:02.620942 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 287/583] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:02 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:02.641819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:02.643098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:02.648819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:02.649202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:02.649974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:02.650438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:02.958671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:02.966438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e3cb604c-64b8-42c1-afe1-7781bdfbb6cb tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.328424 May 13 13:53:02.967020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 297/584] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:02 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:03.198917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-c07b8300-3df8-4209-b866-09a75c81d83b req-9977f096-c461-4063-8fd2-3dd5566cde3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:03.209033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-c07b8300-3df8-4209-b866-09a75c81d83b req-9977f096-c461-4063-8fd2-3dd5566cde3e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:03.209712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-c07b8300-3df8-4209-b866-09a75c81d83b req-9977f096-c461-4063-8fd2-3dd5566cde3e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:03.221767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-c07b8300-3df8-4209-b866-09a75c81d83b req-9977f096-c461-4063-8fd2-3dd5566cde3e service nova] Creating event network-changed:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:53:03.231229 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-c07b8300-3df8-4209-b866-09a75c81d83b req-9977f096-c461-4063-8fd2-3dd5566cde3e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035761 May 13 13:53:03.235369 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 288/585] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:03.636725 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:03.637340 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:03.655332 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:03.656753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:03.658722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:03.659978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:03.880953 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:03.890014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b418cb11-b798-4e6c-b8d5-f222b7e4e06e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.257077 May 13 13:53:03.902948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 298/586] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:03 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:03.985300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:03.986127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:04.002555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:04.003017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:04.003804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:04.004234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:04.261314 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:04.273586 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e20de4b0-b6d2-4607-91a6-375707bca863 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.292984 May 13 13:53:04.278199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 289/587] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:03 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:04.909824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:04.910989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:04.918159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:04.918947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:04.920013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:04.920443 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:05.162146 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:05.170063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-936e9f0a-d1c1-4bfc-87fb-f8371510420c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.265466 May 13 13:53:05.170882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 299/588] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:04 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:05.295079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:05.299098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:05.316394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:05.316982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:05.326711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:05.327417 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:05.513853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:05.525327 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-eed1a72c-df0a-4032-9c81-53dbe6a1cf38 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.238141 May 13 13:53:05.540506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 290/589] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:05 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:06.188012 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:06.188582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:06.195120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:06.195533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:06.196506 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:06.196950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:06.359769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:06.376794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c2281d5d-e00b-4928-ac74-05e464cd1134 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.192526 May 13 13:53:06.378569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 300/590] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:06 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:06.548310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:06.549539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:06.556276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:06.556994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:06.557753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:06.558459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:06.741753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:06.754935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-08ffc1d8-f5ce-47c4-a840-39a29c20f8e3 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.210476 May 13 13:53:06.755528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 291/591] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:06 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:07.394244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:07.395462 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:07.402071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:07.402859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:07.403818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:07.405459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:07.762539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:07.772487 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:07.773076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:07.783134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:07.784363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-63141b32-bf73-4042-9606-82139e55c8e2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.394303 May 13 13:53:07.784717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:07.785611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:07.786362 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:07.793671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 301/592] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:07 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:07.973057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:07.982609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9fb2a1b3-1bca-476e-b4e6-bbb8808c61b2 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.213843 May 13 13:53:07.983744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 292/593] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:07 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:08.802624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:08.803194 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:08.816277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:08.816735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:08.817533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:08.817976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:09.006237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:09.007959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:09.015410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:09.016096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:09.016886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:09.017406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:09.052615 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:09.062601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c96c24f0-1501-4cd0-a0ca-eac1e542ac7a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.264021 May 13 13:53:09.064312 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 302/594] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:08 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:09.185748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:09.197597 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cdef8edb-2b50-438b-b067-f4c691c41645 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.198040 May 13 13:53:09.207524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 293/595] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:08 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:10.081799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:10.083889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:10.098467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:10.099073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:10.099974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:10.100534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:10.216321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:10.216945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:10.239273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:10.239878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:10.242147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:10.242805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:10.429630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:10.451034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-39b10e62-c79a-47d5-be44-a9e23b430c02 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.374552 May 13 13:53:10.452354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 303/596] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:10 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:10.531014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:10.543621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-172f7625-f937-4646-be01-6f49251ee00c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.331819 May 13 13:53:10.554131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 294/597] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:10 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:10.607702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-1ae6a848-6e09-4639-beda-c19f9ec6f42d req-8245b5a0-e15f-4960-a028-67ca2fe115f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2efb78-1e20-4245-99cc-bbe58cb016d3", "name": "network-vif-plugged", "status": "completed", "tag": "194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:10.668805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1ae6a848-6e09-4639-beda-c19f9ec6f42d req-8245b5a0-e15f-4960-a028-67ca2fe115f6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:10.669749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1ae6a848-6e09-4639-beda-c19f9ec6f42d req-8245b5a0-e15f-4960-a028-67ca2fe115f6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:10.697170 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-1ae6a848-6e09-4639-beda-c19f9ec6f42d req-8245b5a0-e15f-4960-a028-67ca2fe115f6 service nova] Creating event network-vif-plugged:194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5 for instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 on hv-cinder-79578 May 13 13:53:10.705062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-1ae6a848-6e09-4639-beda-c19f9ec6f42d req-8245b5a0-e15f-4960-a028-67ca2fe115f6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102823 May 13 13:53:10.711445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 304/598] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:11.470251 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:11.471472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:11.479619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:11.480080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:11.480944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:11.481536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:11.564666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:11.565998 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:11.578530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:11.579246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:11.581699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:11.582408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:11.750195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:11.759302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-553c9ace-4dcc-4d07-a8b8-6621c8420b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.293803 May 13 13:53:11.773413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 295/599] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:11 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:11.888965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:11.900971 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-735fe9fa-d80d-4828-a19c-961e1725e1d8 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.340989 May 13 13:53:11.902205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 305/600] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:11 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:53:12.390758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0aa15fe6-3901-48d4-8e2f-00a90804eac6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Action: 'create', calling method: .version_select at 0x7ff1541f40d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1901887802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTrNoHOIh9WuLKLdDMY8sygozcTPt2qwqEUkGNC008d4jGgWFhRFzzkQAJOqe3JVF/ZSA89OPcUcDeAENAbLGOFg61cotxyuQoFNuUhosK+wlImNfrIVtgTTX7awG5+DA=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:12.406422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-0aa15fe6-3901-48d4-8e2f-00a90804eac6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Getting quotas for project ed8ad4362c094e9aa489ebb4c20fd388. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:53:12.410971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-0aa15fe6-3901-48d4-8e2f-00a90804eac6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Getting quotas for user ce99b3b5a74442b8a0caa85e22b88401 and project ed8ad4362c094e9aa489ebb4c20fd388. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:53:12.439730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0aa15fe6-3901-48d4-8e2f-00a90804eac6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.233898 May 13 13:53:12.440043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 296/601] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:53:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:12.776972 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:12.778167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:12.788502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:12.788997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:12.789817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:12.790277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:12.918545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:12.919557 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:12.929200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:12.932078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:12.933152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:12.933783 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:12.996623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:13.012635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-418359bc-a746-48d1-9ad8-95080d81ddc8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.239695 May 13 13:53:13.013272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 306/602] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:12 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:13.167156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:13.175712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c747e2fa-179a-4fdf-a116-144a87b6155c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.261922 May 13 13:53:13.176495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 297/603] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:12 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:13.960723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-df254f8b-9120-488b-b1cb-74463b0eaea4 req-ea5970c8-ca7e-4a6c-9058-78f11ca16994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf", "name": "network-vif-plugged", "status": "completed", "tag": "900f685a-f7b0-40e2-86a8-40d9d9abcacb"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:13.968974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-df254f8b-9120-488b-b1cb-74463b0eaea4 req-ea5970c8-ca7e-4a6c-9058-78f11ca16994 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:13.969691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-df254f8b-9120-488b-b1cb-74463b0eaea4 req-ea5970c8-ca7e-4a6c-9058-78f11ca16994 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:13.984547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-df254f8b-9120-488b-b1cb-74463b0eaea4 req-ea5970c8-ca7e-4a6c-9058-78f11ca16994 service nova] Creating event network-vif-plugged:900f685a-f7b0-40e2-86a8-40d9d9abcacb for instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf on hv-cinder-79578 May 13 13:53:13.990989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-df254f8b-9120-488b-b1cb-74463b0eaea4 req-ea5970c8-ca7e-4a6c-9058-78f11ca16994 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 May 13 13:53:13.991748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 307/604] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:14.030887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:14.031500 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:14.038634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:14.039083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:14.040100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:14.040638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:14.201862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:14.202874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:14.203356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:14.212700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:14.212845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c89c7ced-93ed-484e-a385-4155ef36eb45 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1266 microversion: 2.1 time: 0.185990 May 13 13:53:14.213768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:14.213957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 298/605] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:14 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:14.215266 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:14.215760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:14.354868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:14.365003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-57408584-c29f-4f7b-95ef-367059ef7412 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.167762 May 13 13:53:14.365857 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 308/606] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:14 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:15.236116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:15.237133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:15.244564 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.244980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.245991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.246445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.382268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:15.382981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:15.386180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:15.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.391079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.392441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.393002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.396947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68fa7a25-7a60-463e-bfa2-39d8b2fc27a9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1453 microversion: 2.1 time: 0.169989 May 13 13:53:15.397947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 299/607] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:15 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:15.414171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:15.414784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:15.422081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.422081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.422081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:15.422540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:15.554249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:15.562930 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d711df48-efdf-454b-8a63-5d018f1480fd tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.184463 May 13 13:53:15.563947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 309/608] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:15 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:53:15.584112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:15.592132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-672f0bf3-7853-4cbe-9bcc-0b0bdc9b77ea tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1453 microversion: 2.1 time: 0.181725 May 13 13:53:15.592722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 300/609] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:15 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:53:16.580098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:16.581458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:16.589619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:16.590091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:16.590882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:16.591578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:17.008480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:17.016183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-47d2222c-7a9d-41b3-8832-76c29788ad28 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1319 microversion: 2.1 time: 0.440531 May 13 13:53:17.016759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 310/610] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:16 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:17.807241 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-34d4bb04-9d6b-42c6-8465-09c3a1a5c2e4 req-eeba3024-fb5e-49c2-ac3a-a318b5f91342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2efb78-1e20-4245-99cc-bbe58cb016d3", "tag": "194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:17.815906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-34d4bb04-9d6b-42c6-8465-09c3a1a5c2e4 req-eeba3024-fb5e-49c2-ac3a-a318b5f91342 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:17.816343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-34d4bb04-9d6b-42c6-8465-09c3a1a5c2e4 req-eeba3024-fb5e-49c2-ac3a-a318b5f91342 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:17.828788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-34d4bb04-9d6b-42c6-8465-09c3a1a5c2e4 req-eeba3024-fb5e-49c2-ac3a-a318b5f91342 service nova] Creating event network-changed:194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5 for instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 on hv-cinder-79578 May 13 13:53:17.834619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-34d4bb04-9d6b-42c6-8465-09c3a1a5c2e4 req-eeba3024-fb5e-49c2-ac3a-a318b5f91342 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 May 13 13:53:17.835234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 301/611] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:53:18.033762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:18.034589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:18.041541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:18.042293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:18.043224 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:18.043816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:18.180148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:53:18.190118 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9143f884-686b-4ee6-a8c0-3da03e200887 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1508 microversion: 2.1 time: 0.159491 May 13 13:53:18.190878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 311/612] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:53:18 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:53:18.208033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f90e69-5f18-454d-b0ad-388d4a941fb5", "device": "/dev/sdb"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:53:18.209218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:18.215332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:18.215773 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:18.216534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:18.216963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:18.992810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b76c5fae-ec85-4422-be9e-1602e98f56a7 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "POST /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789068 May 13 13:53:18.993849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 302/613] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:53:18 2022] POST /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:59.111742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:59.112358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:53:59.118595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:59.119052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:59.119811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:59.120455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:59.246982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'services' on Instance uuid bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:53:59.368144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ebd4a84b-04cb-46e6-a1f6-02d8cb57706b tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "DELETE /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf/os-volume_attachments/c1f90e69-5f18-454d-b0ad-388d4a941fb5" status: 202 len: 0 microversion: 2.1 time: 0.260182 May 13 13:53:59.368732 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 312/614] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 13:53:59 2022] DELETE /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf/os-volume_attachments/c1f90e69-5f18-454d-b0ad-388d4a941fb5 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:54:02.610896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:02.611488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:02.618162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:02.618606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:02.619408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:02.619840 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:02.645877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:54:02.649732 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-9114558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1901887802", "security_groups": [{"name": "tempest-secgroup-smoke-387716568"}], "networks": [{"uuid": "98b82e67-a61f-4436-80c5-070fe19c8579"}], "block_device_mapping_v2": [{"uuid": "f1b3f0a8-77e3-4d6d-b12e-ec4ccdb07965", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:02.737115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-adb875d6-6c2e-4e50-8b2a-bc00fc921f6c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "DELETE /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 204 len: 0 microversion: 2.1 time: 0.130716 May 13 13:54:02.741054 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 303/615] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:54:02 2022] DELETE /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:54:02.747851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:02.748634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:02.760071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:02.761788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:02.762713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:02.763074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:02.783540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] validate_networks() for [('98b82e67-a61f-4436-80c5-070fe19c8579', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:54:02.900213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:02.909231 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fdc7bacd-74d4-4be7-b724-eae5ec0aa73f tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1514 microversion: 2.1 time: 0.166226 May 13 13:54:02.909701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 304/616] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:02 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:03.170491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:54:03.170938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:54:03.171404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:54:03.171807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:54:03.172248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:54:03.181767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:03.182250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:03.183205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:03.183637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:03.199906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Getting quotas for project ed8ad4362c094e9aa489ebb4c20fd388. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:54:03.203827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Getting quotas for user ce99b3b5a74442b8a0caa85e22b88401 and project ed8ad4362c094e9aa489ebb4c20fd388. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:54:03.267077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:54:03.270664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1b3f0a8-77e3-4d6d-b12e-ec4ccdb07965',volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:54:03.408845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0e051604-b6aa-4285-b7ec-a087972ec0e4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763714 May 13 13:54:03.409648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 313/617] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:54:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:54:03.420321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1239ff99-6adc-4701-9821-7b6f30911790 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:03.420870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1239ff99-6adc-4701-9821-7b6f30911790 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:03.474081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1239ff99-6adc-4701-9821-7b6f30911790 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:03.481006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1239ff99-6adc-4701-9821-7b6f30911790 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1086 microversion: 2.1 time: 0.065312 May 13 13:54:03.481580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 305/618] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:03 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1086 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:03.930396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:03.931324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:03.938947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:03.939400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:03.940166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:03.940603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:04.080919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:04.088314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4b250a1b-0e15-4ea3-8c1a-cfc92b849b1c tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1514 microversion: 2.1 time: 0.164827 May 13 13:54:04.088866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 314/619] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:03 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:04.498468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:04.499073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:04.506083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:04.506524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:04.507324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:04.507756 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:04.568528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:04.576205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-468b22fa-70b4-4988-b4ba-95d141a4818d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1128 microversion: 2.1 time: 0.081635 May 13 13:54:04.576828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 306/620] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:04 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1128 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:05.104702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:05.105305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:05.111430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:05.111996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:05.112756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:05.113329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:05.251734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:05.259209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a082b0d7-421d-42f2-a125-d433a5031658 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1514 microversion: 2.1 time: 0.158363 May 13 13:54:05.259799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 315/621] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:05 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:05.593392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:05.594843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:05.602183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:05.602686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:05.603560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:05.604090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:05.712928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:05.722725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e6204d3b-74c2-482d-9914-6f88f6659e6c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1202 microversion: 2.1 time: 0.133873 May 13 13:54:05.731212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 307/622] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:05 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1202 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:05.996279 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-8d6291fe-e56f-420f-b604-406ebe6159f0 req-e03683e3-b5b2-44be-b065-bbd2ede4fc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf", "name": "network-vif-deleted", "tag": "900f685a-f7b0-40e2-86a8-40d9d9abcacb"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:06.006370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8d6291fe-e56f-420f-b604-406ebe6159f0 req-e03683e3-b5b2-44be-b065-bbd2ede4fc04 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.006807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8d6291fe-e56f-420f-b604-406ebe6159f0 req-e03683e3-b5b2-44be-b065-bbd2ede4fc04 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.017895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-8d6291fe-e56f-420f-b604-406ebe6159f0 req-e03683e3-b5b2-44be-b065-bbd2ede4fc04 service nova] Creating event network-vif-deleted:900f685a-f7b0-40e2-86a8-40d9d9abcacb for instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf on hv-cinder-79578 May 13 13:54:06.022902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-8d6291fe-e56f-420f-b604-406ebe6159f0 req-e03683e3-b5b2-44be-b065-bbd2ede4fc04 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 May 13 13:54:06.023535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 316/623] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:06.277123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:06.278242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:06.284567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.285011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.285786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.286249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.319599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.320048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.320706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'fault' on Instance uuid bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:54:06.364415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:06.372123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1dfa4b90-ddf5-4c15-810c-aceb8d5ed379 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1309 microversion: 2.1 time: 0.099114 May 13 13:54:06.372689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 308/624] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:06 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:06.741259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:06.741946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:06.748437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.748882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.749641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:06.750168 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:06.950091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:06.959238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eb5b0804-3160-41a0-a266-162d80331510 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.222130 May 13 13:54:06.960155 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 317/625] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:06 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:07.239220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-a076703f-c4cd-4f4d-adf2-2132f945af62 req-068f8f67-6d56-44e7-8bde-201b503618e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:07.251668 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-a076703f-c4cd-4f4d-adf2-2132f945af62 req-068f8f67-6d56-44e7-8bde-201b503618e1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.252351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-a076703f-c4cd-4f4d-adf2-2132f945af62 req-068f8f67-6d56-44e7-8bde-201b503618e1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:07.267424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-a076703f-c4cd-4f4d-adf2-2132f945af62 req-068f8f67-6d56-44e7-8bde-201b503618e1 service nova] Creating event network-changed:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 13:54:07.272518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-a076703f-c4cd-4f4d-adf2-2132f945af62 req-068f8f67-6d56-44e7-8bde-201b503618e1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038439 May 13 13:54:07.273332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 309/626] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:07.389513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:07.390144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:07.396570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.396988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:07.397764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.398268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:07.429485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.429925 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:07.430391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'fault' on Instance uuid bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:54:07.476989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:07.484503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0d58eef2-b79a-4322-997f-258988e51a9a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1309 microversion: 2.1 time: 0.098900 May 13 13:54:07.485064 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 318/627] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:07 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:07.980340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:07.981154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:07.988981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.989524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:07.990411 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:07.990900 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.132514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:08.140505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6b992861-5b12-465c-9338-81d332b26776 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.165332 May 13 13:54:08.141070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 310/628] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:07 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:08.503577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:08.504447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:08.512840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:08.513454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.514586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:08.515207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.549816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:08.550287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.551216 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'fault' on Instance uuid bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:54:08.592452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:08.600860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-667174e6-9b54-4b4a-b47f-8918f4797ce4 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1309 microversion: 2.1 time: 0.102518 May 13 13:54:08.601400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 319/629] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:08 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:08.635159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:08.635689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:08.642822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:08.643274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.644037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:08.644469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:08.672379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a4d26e3f-110e-4c2b-9f2c-0751b6fe6499 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/ips" status: 200 len: 153 microversion: 2.20 time: 0.041034 May 13 13:54:08.672964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 311/630] 10.222.0.24 () {60 vars in 1288 bytes} [Fri May 13 13:54:08 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:54:09.161427 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:09.162701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:09.172916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:09.173651 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:09.174950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:09.175758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:09.320006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:09.327531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-51a8936e-d035-4f93-8477-da15280566d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.172451 May 13 13:54:09.328110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 320/631] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:09 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:09.618024 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:09.618664 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:09.625132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:09.625571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:09.626368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:09.626803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:09.660975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:09.661600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:09.661844 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lazy-loading 'fault' on Instance uuid bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:54:09.703259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9f35a812544a4584deb7276166d0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a1d6b4748a4489b8364d566debd6fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:09.711207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-487181c0-d768-4812-a91f-b1845ef914d6 tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 200 len: 1309 microversion: 2.1 time: 0.097016 May 13 13:54:09.711770 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 312/632] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:09 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:10.348958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:10.349771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:10.358096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:10.358597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:10.359350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:10.359775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:10.494093 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:10.502281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6b30e3b3-63fd-486d-a90d-c2b27d401466 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.159827 May 13 13:54:10.502849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 321/633] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:10 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:10.728384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:10.728990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] [instance: bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:10.735930 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:10.736412 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:10.737201 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:10.737631 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:10.752329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] HTTP exception thrown: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Request method failure captured: May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf HTTP/1.1 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmIOu9kXjjJXkAiTsI3wk49Z2n9rxvhsBZAibgvJvfvXa1d8ocYTDzheWEzsSGNxL3J4gV2Yvk6U2VZX9-sbTpqIld1TgX6ppzwgnv7Fd8fDvsrU3RNWdEj-MHkRwQxyTn5Z-1LYJVJAZ0EQwZLkk2635gCC3MLycpqmwVAJ3En6540 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 79a1d6b4748a4489b8364d566debd6fd May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:54:10.754032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/79a1d6b4748a4489b8364d566debd6fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 79a1d6b4748a4489b8364d566debd6fd May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-227579402 May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesSnapshotTestJSON-227579402-project May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4f9f35a812544a4584deb7276166d0d3 May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesSnapshotTestJSON-227579402-project May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. May 13 13:54:10.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf'} May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:54:10.756234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. May 13 13:54:10.757457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:54:10.758582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] Returning 404 to user: Instance bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:54:10.758582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d1227d28-d849-455e-97b3-d72d34a7f15a tempest-VolumesSnapshotTestJSON-227579402 tempest-VolumesSnapshotTestJSON-227579402-project] 10.222.0.24 "GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf" status: 404 len: 111 microversion: 2.1 time: 0.030938 May 13 13:54:10.758582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 313/634] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:10 2022] GET /compute/v2.1/servers/bbb7056c-bb82-4ded-b1af-ffb02ad9c6bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:54:11.523591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:11.524446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:11.532242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:11.532687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:11.533439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:11.533860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:11.670750 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:11.678279 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ea3a6635-2c9e-473f-9756-a78ca430b273 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.161184 May 13 13:54:11.678812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 322/635] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:11 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:12.305856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:12.306463 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:12.313063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.313508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.314313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.314744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.339088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-acced58a-6fb4-4c29-9bb1-7353a9e1e937 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/ips" status: 200 len: 144 microversion: 2.1 time: 0.037201 May 13 13:54:12.339672 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 314/636] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 13:54:12 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:12.696149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:12.696841 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:12.703447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.703901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.704653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.705173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.843983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:12.852098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bd546c11-f9e8-4e41-bb64-23f3a4b7a461 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1269 microversion: 2.1 time: 0.160336 May 13 13:54:12.852817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 323/637] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:12 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:12.874687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:12.875222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:12.881843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.882319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.883085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:12.883525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:12.907552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lazy-loading 'flavor' on Instance uuid 37444ba4-a1cb-48d8-adbf-8f58200aba40 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:54:13.201375 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-030b6e2b-a250-431e-8241-8e0b52072efc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/action" status: 202 len: 0 microversion: 2.20 time: 0.331214 May 13 13:54:13.202574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 315/638] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 13 13:54:12 2022] POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 13:54:13.212097 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:13.212832 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:13.221551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:13.222008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:13.222887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:13.223340 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:13.409159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:13.418720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:13.420399 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:13.421996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-163ae896-d881-409a-b348-1b529b7ecf34 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.214579 May 13 13:54:13.423214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 324/639] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:13 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:13.872768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:13.874667 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:13.881818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:13.882178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:13.883205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:13.883648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:14.067703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:14.077458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-95f08b99-38a7-434c-82c0-341411d76054 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.211702 May 13 13:54:14.078069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 316/640] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:13 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:14.442532 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:14.443103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:14.450193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:14.450636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:14.451388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:14.451810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:14.646151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:14.655369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:14.656879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:14.658077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a2328b72-e1ea-4da0-8fc8-394ada8bca86 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.219758 May 13 13:54:14.658622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 325/641] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:14 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:15.097696 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:15.098549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:15.105630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:15.106015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:15.106888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:15.107397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:15.245157 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:15.253158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-863a8fd3-c56e-49f2-bcca-937a4df5eca5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.161503 May 13 13:54:15.253721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 317/642] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:15 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:15.681619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:15.682525 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:15.693166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:15.693908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:15.695263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:15.696029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:15.854079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:15.863251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:15.864757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:15.865919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-757c0572-044e-49a7-900f-566289378f6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.191448 May 13 13:54:15.866511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 326/643] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:15 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:16.274094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:16.275161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:16.286709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:16.287464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:16.288801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:16.289686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:16.425298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:16.437072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ede95e4c-becf-4f17-b344-aca26c80643b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.169191 May 13 13:54:16.437813 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 318/644] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:16 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:16.889220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:16.890199 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:16.900719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:16.901585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:16.903249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:16.903663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:17.036225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:17.044120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:17.045602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:17.046784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-50d2190b-616e-435f-a842-46d5b028093e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.164494 May 13 13:54:17.047343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 327/645] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:16 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:17.458697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:17.459690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:17.468221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:17.468675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:17.469437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:17.469873 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:17.608718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:17.619643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-81ca227f-b083-4556-85ea-4b6a95b5708e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.167206 May 13 13:54:17.620468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 319/646] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:17 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:18.067455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:18.068239 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:18.076223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:18.076673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:18.077441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:18.077868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:18.223786 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:18.233208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:18.234779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:18.235952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-943c2825-c716-4fe4-8562-d986847d6514 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.174008 May 13 13:54:18.236920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 328/647] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:18 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:18.636380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:18.637235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:18.643710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:18.644156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:18.644920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:18.645397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:18.863649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:18.873705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-656456f3-fdbb-4ca9-87da-36b2c93385fb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.241164 May 13 13:54:18.882506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 320/648] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:18 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:19.256062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:19.256775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:19.263387 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.263828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:19.264580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.265038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:19.329488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d0d40ce-0323-42e9-908d-67a6c8e6f7c6"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:19.330681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:19.336869 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.337312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:19.338109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.338536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:19.640537 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-15471c95-b649-4e33-9549-9edc6f457065 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314573 May 13 13:54:19.641437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 321/649] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:54:19 2022] POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:54:19.708781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:19.718248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:19.721860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:19.723457 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6fa8d875-beb1-4b65-ada4-d27b12a3a5be tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.471332 May 13 13:54:19.735079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 329/650] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:19 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:19.891358 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:19.892124 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:19.898675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.899113 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:19.899867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:19.900464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:20.050423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:20.058514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8643a66e-7f83-49d9-befc-7614d9a21f38 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.171413 May 13 13:54:20.058991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 322/651] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:19 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:20.851893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:20.852495 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:20.858606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:20.859047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:20.859783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:20.860203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:21.013525 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:21.021820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:21.023494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:21.024819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4032b272-6155-480a-a3d6-3cc70d4b4773 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.286038 May 13 13:54:21.025551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 330/652] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:20 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:21.075921 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:21.076788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:21.085248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:21.085707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:21.086605 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:21.087120 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:21.223178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:21.231034 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ac554054-81df-4b80-9669-2f7fa1724e6d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.159957 May 13 13:54:21.231593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 323/653] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:21 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:22.047687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:22.048597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:22.058830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:22.059205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:22.059963 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:22.060391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:22.199984 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:22.212613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:22.215037 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:22.216221 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2b0cbc7c-47b0-42f5-a2ea-ffcce31a8b24 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.174986 May 13 13:54:22.216786 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 331/654] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:22 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:22.248019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:22.248634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:22.255367 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:22.255841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:22.256588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:22.257023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:22.397083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:22.406455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-46596c94-39fa-4e8b-9235-8b5856ffb018 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.162314 May 13 13:54:22.407015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 324/655] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:22 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:23.234417 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:23.234964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:23.240777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:23.241346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:23.241968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:23.242433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:23.384543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:23.392631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:23.394200 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:23.395516 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-36cfc015-cfbe-44ae-9e70-2f698ab043ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.165214 May 13 13:54:23.396070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 332/656] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:23 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:23.422489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:23.426015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:23.433245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:23.433699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:23.434522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:23.434952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:23.574187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:23.582842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7dc6ff5d-0ba5-47a7-ba32-905470bff6d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.164324 May 13 13:54:23.583932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 325/657] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:23 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:24.415276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:24.415896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:24.422749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:24.423200 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:24.424257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:24.424686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:24.568139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:24.577659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:24.579436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:24.580744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e1889dc3-3e97-4c5d-94b2-7be0fea96309 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.169457 May 13 13:54:24.581392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 333/658] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:24 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:24.600925 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:24.601661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:24.608401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:24.608935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:24.609777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:24.610326 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:24.745883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:24.757724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-20fa2bcf-5b26-42a2-912d-e5260b1c967d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.160503 May 13 13:54:24.758546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 326/659] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:24 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:25.601294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:25.602208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:25.609290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:25.609746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:25.610561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:25.611000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:25.752296 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:25.765388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:25.767481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:25.768900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e8457838-a75c-405f-9a90-89ebd9d9a0c7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.172505 May 13 13:54:25.769433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 334/660] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:25 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:25.775157 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:25.775766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:25.782622 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:25.783080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:25.783874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:25.784308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:25.930520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:25.938372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7e85eaa0-d850-4059-9ae3-1674e1636a44 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.167035 May 13 13:54:25.938941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 327/661] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:25 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:26.786816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:26.787458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:26.794122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:26.794573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:26.795537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:26.795976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:26.943277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:26.951686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:26.953163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:26.954328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-26d157a4-4c27-4098-a036-8271c4430ae5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.171376 May 13 13:54:26.954865 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 335/662] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:26 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:26.955452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:26.956038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:26.962648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:26.963104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:26.963911 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:26.964377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:27.103298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:27.111374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-245bf8a7-1524-4a36-bee1-2188fd6ed327 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.159697 May 13 13:54:27.111940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 328/663] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:26 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:27.976049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:27.976765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:27.986647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:27.987301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:27.988544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:27.989268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:28.124724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:28.127882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:28.129047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:28.132770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:28.134284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:28.136038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:28.136178 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1a9b7043-3479-4f25-af34-2b6af5d2eaf5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.166226 May 13 13:54:28.136262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:28.137000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:28.137432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:28.142669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 336/664] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:27 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:28.269023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:28.276752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e44d929f-a004-4eeb-97d5-f0a2d94f2762 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.152565 May 13 13:54:28.277351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 329/665] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:28 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:29.153839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:29.154480 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:29.160582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:29.161040 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:29.161792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:29.162300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:29.294896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:29.295502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:29.300785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:29.302269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:29.302734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:29.303518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:29.303991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:29.309160 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:29.310921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:29.313562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bf410f11-6e8c-4ec3-a95f-1e04d70bff74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.162872 May 13 13:54:29.314562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 337/666] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:29 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:29.439205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:29.447121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-caa94a85-d255-47c5-b177-a8ee8cbff082 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.157008 May 13 13:54:29.447685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 330/667] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:29 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:30.337909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:30.338937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:30.346916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:30.347493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:30.348425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:30.348940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:30.465633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:30.466538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:30.475128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:30.475581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:30.476606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:30.477882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:30.498082 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:30.506764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:30.508486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:30.509715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-714737c3-8041-4442-9882-8ccb3afa07e6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.179605 May 13 13:54:30.510494 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 338/668] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:30 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:30.626555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:30.633915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c3f88257-055b-4183-86cd-8fab2fadf505 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.172991 May 13 13:54:30.634807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 331/669] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:30 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:31.529757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:31.530393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:31.536917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:31.537373 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:31.538182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:31.538624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:31.653168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:31.655051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:31.663619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:31.664071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:31.664857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:31.665290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:31.675577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:31.683596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:31.685024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:31.686210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c33444fe-d04f-42d9-a6e5-cc9382ac2c22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.161444 May 13 13:54:31.686774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 339/670] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:31 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:31.806489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:31.814671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2333c16d-f9f7-4f5d-b6fb-ad437ad92a1d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.166992 May 13 13:54:31.815242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 332/671] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:31 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:32.705146 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:32.705713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:32.716753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:32.717241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:32.718262 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:32.718877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:32.831423 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:32.832069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:32.839153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:32.839652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:32.840666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:32.841274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:32.872999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:32.881050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:32.882561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:32.883717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d0d6c261-6612-430f-9cdc-21e1006dbccf tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.182497 May 13 13:54:32.884286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 340/672] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:32 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:32.979360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:32.987505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-944ca89b-eac3-4c4e-b054-c4581e30ceb5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.160218 May 13 13:54:32.988212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 333/673] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:32 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:33.485132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b26052af-dba3-4502-8fcc-fdf747c687d1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:33.491546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b26052af-dba3-4502-8fcc-fdf747c687d1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:33.491994 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b26052af-dba3-4502-8fcc-fdf747c687d1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:33.552758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b26052af-dba3-4502-8fcc-fdf747c687d1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Going to try to stop instance {{(pid=123955) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:54:33.602602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b26052af-dba3-4502-8fcc-fdf747c687d1 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.121063 May 13 13:54:33.606321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 341/674] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:54:33 2022] POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:54:33.611731 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:33.612345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:33.618533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:33.618977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:33.619744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:33.620247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:33.759336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:33.768091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-60e00eb7-8c6f-4f86-8f72-8c7e02ab254a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.160465 May 13 13:54:33.768695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 334/675] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:33 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:33.903655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:33.904445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:33.911680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:33.912252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:33.913444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:33.913908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:34.008434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:34.009106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:34.016443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:34.016872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:34.017830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:34.018291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:34.061747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:34.070785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:34.072254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:34.073434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-942926d1-1ac7-43ba-b8a0-276ba2f32c6c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.174577 May 13 13:54:34.074014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 342/676] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:33 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:34.167768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:34.175939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5d0dbfa1-3204-49c4-9d17-9ee3341005d2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.171282 May 13 13:54:34.176519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 335/677] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:34 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:34.789928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:34.791262 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:34.799981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:34.800429 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:34.801194 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:34.801629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:34.937068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:34.945020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d32badb5-ba09-4965-92a2-e17a63c71dc7 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.161273 May 13 13:54:34.945588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 343/678] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:34 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:35.093915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:35.094557 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:35.101295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:35.101753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:35.102564 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:35.103002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:35.192825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:35.193392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:35.201170 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:35.201903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:35.202808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:35.203342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:35.250705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:35.260115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:35.262099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:35.263727 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4f2f38db-c90b-47c6-b256-463a16d0ca6d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.174422 May 13 13:54:35.264365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 336/679] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:35 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:35.332046 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-fffa44ac-d254-407f-a5fa-673ffaa1653c req-9717b5ed-234a-4d7e-9b0d-e1565c94a321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "name": "network-vif-plugged", "status": "completed", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:35.343176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-fffa44ac-d254-407f-a5fa-673ffaa1653c req-9717b5ed-234a-4d7e-9b0d-e1565c94a321 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:35.343697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-fffa44ac-d254-407f-a5fa-673ffaa1653c req-9717b5ed-234a-4d7e-9b0d-e1565c94a321 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:35.357493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:35.359698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-fffa44ac-d254-407f-a5fa-673ffaa1653c req-9717b5ed-234a-4d7e-9b0d-e1565c94a321 service nova] Creating event network-vif-plugged:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 13:54:35.368177 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-fffa44ac-d254-407f-a5fa-673ffaa1653c req-9717b5ed-234a-4d7e-9b0d-e1565c94a321 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 May 13 13:54:35.368782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 337/680] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:35.371838 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8b952da6-6437-4355-a094-946bc1151aa6 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.182282 May 13 13:54:35.372164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 344/681] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:35 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:36.152216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:36.153333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:36.160043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.160498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.161418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.161902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.283367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:36.284066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:36.290881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.291320 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.292574 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.293109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.298918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:36.306976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ecf1e774-e2a3-4433-b47a-0b9e1356708b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.343366 May 13 13:54:36.307522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 338/682] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:35 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:36.388580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:36.389189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:36.395372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.395811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.396584 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:36.397038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:36.438807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:36.446529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:36.448684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:36.450287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-706024ca-20da-4535-bf30-b515b93f8093 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.171045 May 13 13:54:36.451015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 345/683] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:36 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:36.534602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:36.542144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-14353bbf-bc2a-44e9-9bab-0c67bd396d56 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.157320 May 13 13:54:36.543052 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 339/684] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:36 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:37.324681 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:37.325897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:37.332355 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.332803 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.333549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.333965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.469693 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:37.471143 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:37.477362 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:37.477628 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.478116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.478897 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.479332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.485397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4aa5f7e8-4a96-4484-a67f-f2b9cf8c4223 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.164714 May 13 13:54:37.485967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 346/685] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:37 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:37.562156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:37.562772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:37.569648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.570331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.571519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:37.572148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:37.620295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:37.629096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:37.630627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:37.632068 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-53365a29-e9b4-48ff-8b49-8639dc08fea6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.166585 May 13 13:54:37.632591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 340/686] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:37 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:37.716390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:37.723909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-67d0c20d-ce4a-434c-81fa-e419a7acd492 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.167571 May 13 13:54:37.724540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 347/687] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:37 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:38.502928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:38.503569 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:38.510310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.510975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.511646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.512086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.645941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:38.650881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:38.651544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:38.654796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f693c6e8-e8b1-4ab3-9264-e84f42d9adfb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.155742 May 13 13:54:38.655385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 341/688] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:38 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:38.657995 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.658528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.659292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.659718 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.741242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:38.742466 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:38.749064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.749596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.750535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:38.750969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:38.797056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:38.805092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:38.806601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:38.807747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-16d24210-32ab-4e61-a88b-d9aaacf2e7db tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.160809 May 13 13:54:38.808575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 348/689] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:38 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:38.884129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:38.892394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3861d71e-2dc3-4ea0-bd0a-f45f44c0dc32 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1257 microversion: 2.1 time: 0.155401 May 13 13:54:38.893096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 342/690] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:38 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:54:39.672691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:39.673251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:39.679513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.680257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.681013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.681426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.826986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:39.826986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:39.835115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.835963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.836777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.837222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.910295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:39.921819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6bdcbbe1-7c90-4f5e-a158-a6a81ac1c101 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.252996 May 13 13:54:39.922689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 349/691] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:39 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:39.943765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:39.944936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:39.951828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.952361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.953236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:39.953746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:39.986853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:39.996825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:39.998515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:39.999694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-334a4f8d-da42-45d3-9ced-f8bdd75672ff tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.177567 May 13 13:54:40.000638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 343/692] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:39 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:40.107366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:40.115047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-013e340e-d3a4-4a9c-9044-4caffcd46d28 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1441 microversion: 2.1 time: 0.190820 May 13 13:54:40.115616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 350/693] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:39 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:40.132398 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:40.133042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:40.139805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:40.140262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:40.141065 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:40.141518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:40.325580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:40.335134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e6a8cd4b-b845-4fba-bbc5-c99b9daf2c78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1441 microversion: 2.1 time: 0.207556 May 13 13:54:40.335735 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 344/694] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:40 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1441 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:40.942445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:40.943027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:40.949015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:40.949563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:40.950596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:40.951026 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:41.018706 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:41.019425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:41.026296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:41.026828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:41.027655 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:41.028449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:41.169460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:41.178428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:41.180237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:41.181428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2e7933c7-bab6-4e92-a355-03727b6aed06 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.167655 May 13 13:54:41.182017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 345/695] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:41 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:41.197144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:41.205184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ca246fc5-98d6-4143-98cc-59b68e3e9632 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.267021 May 13 13:54:41.205739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 351/696] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:40 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:41.380863 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-7d46acd6-57a4-42fc-8a01-86aaa20d7fe3 req-624e9120-ffaf-47d1-bb91-57da1241a8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "name": "network-vif-plugged", "status": "completed", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:41.391854 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-7d46acd6-57a4-42fc-8a01-86aaa20d7fe3 req-624e9120-ffaf-47d1-bb91-57da1241a8bf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:41.392383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-7d46acd6-57a4-42fc-8a01-86aaa20d7fe3 req-624e9120-ffaf-47d1-bb91-57da1241a8bf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:41.411436 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-7d46acd6-57a4-42fc-8a01-86aaa20d7fe3 req-624e9120-ffaf-47d1-bb91-57da1241a8bf service nova] Creating event network-vif-plugged:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:54:41.417669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-7d46acd6-57a4-42fc-8a01-86aaa20d7fe3 req-624e9120-ffaf-47d1-bb91-57da1241a8bf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044044 May 13 13:54:41.422504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 346/697] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:42.200102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:42.200687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:42.207105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:42.207544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:42.208307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:42.208754 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:42.223740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:42.225086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:42.231979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:42.232443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:42.233221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:42.233656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:42.369224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:42.378076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-05b9750e-9014-48f1-ac34-b34d7db722e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.159069 May 13 13:54:42.378677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 347/698] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:42 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:42.638327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:42.647183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:42.648860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:42.650165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-85acdf1d-4ebe-4442-9332-2a7335b45bc7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.453850 May 13 13:54:42.651634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 352/699] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:42 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:42.807858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-525ca4f0-f65f-414d-9d61-7a9ecad64b45 req-5fc19e34-de32-450b-86a7-13e15d6ea273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:42.816561 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-525ca4f0-f65f-414d-9d61-7a9ecad64b45 req-5fc19e34-de32-450b-86a7-13e15d6ea273 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:42.816998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-525ca4f0-f65f-414d-9d61-7a9ecad64b45 req-5fc19e34-de32-450b-86a7-13e15d6ea273 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:42.829476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-525ca4f0-f65f-414d-9d61-7a9ecad64b45 req-5fc19e34-de32-450b-86a7-13e15d6ea273 service nova] Creating event network-changed:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 13:54:42.834399 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-525ca4f0-f65f-414d-9d61-7a9ecad64b45 req-5fc19e34-de32-450b-86a7-13e15d6ea273 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202790 May 13 13:54:42.835000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 348/700] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:54:43.395236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:43.396740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:43.403327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:43.403770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:43.404540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:43.404972 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:43.544909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:43.553528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2d3aa376-af35-4dfc-9a69-f16b1fa293c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.162089 May 13 13:54:43.554137 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 353/701] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:43 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:43.670340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:43.671394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:43.678295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:43.679186 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:43.680098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:43.680534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:43.820634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:43.828420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:43.829887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:43.831061 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-742c0ad9-a7c4-4874-b121-c64dbde6aaae tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.166000 May 13 13:54:43.831613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 349/702] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:43 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:44.571726 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:44.572377 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:44.579266 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:44.579712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:44.580477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:44.580903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:44.722821 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:44.730983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5f26db12-1746-47a3-8d4f-371cffeb62f9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.163185 May 13 13:54:44.731596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 354/703] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:44 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:44.852948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:44.853671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:44.860961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:44.861409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:44.862213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:44.862643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:45.004824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:45.013248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:45.014777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:45.015941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-167bc587-d286-49f5-8bb7-e7b8e692b749 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.167881 May 13 13:54:45.016494 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 350/704] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:44 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:45.749425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:45.750138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:45.757450 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:45.757913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:45.758820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:45.759304 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:45.891057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:45.902808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0237b047-62f7-46f4-a86f-1a8c6a99dc7b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.157895 May 13 13:54:45.903698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 355/705] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:45 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:46.038749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:46.039568 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:46.050850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:46.051602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:46.052860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:46.053746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:46.191674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:46.200196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:46.201663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:46.202844 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5ee080f6-5033-41e1-81fe-87f2cc826794 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1746 microversion: 2.20 time: 0.170794 May 13 13:54:46.203401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 351/706] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:46 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:46.921794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:46.922549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:46.930053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:46.930596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:46.931472 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:46.932310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:47.067112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:47.082707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2ee23b9a-9991-49f4-9185-1006fb21c0ec tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.165569 May 13 13:54:47.083379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 356/707] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:46 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:47.221818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:47.222768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:47.230170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:47.231352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:47.232582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:47.233027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:47.374826 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:47.384341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:47.386142 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:47.388483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-30a3eab0-3c43-4825-9d7b-b6c2ad4b151d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.171090 May 13 13:54:47.389122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 352/708] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:47 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:48.100203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:48.100771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:48.107328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:48.107769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:48.108524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:48.108952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:48.248846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:48.256859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-adff9dff-d7b0-42e0-97be-2a6f826b01c9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1722 microversion: 2.1 time: 0.160621 May 13 13:54:48.257422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 357/709] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:48 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:48.407745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:48.408299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:48.414504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:48.415257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:48.416042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:48.416474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:48.560283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:48.568132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:48.569600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:48.570803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4a7684d4-bb7a-4422-8bd3-3ac7a99abe51 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.167104 May 13 13:54:48.571351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 353/710] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:48 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:49.274579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:49.275186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:49.281986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.282490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.283346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.283831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.422232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:49.430500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-238ba4c2-25be-4c7d-943d-908a7d61febd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1699 microversion: 2.1 time: 0.159764 May 13 13:54:49.431072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 358/711] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:49 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:49.447152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-84edaec9-659a-495d-ae46-29bfcc131413 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:54:49.453664 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-84edaec9-659a-495d-ae46-29bfcc131413 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.454132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-84edaec9-659a-495d-ae46-29bfcc131413 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.516573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-84edaec9-659a-495d-ae46-29bfcc131413 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Going to try to start instance {{(pid=123954) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:54:49.563016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-84edaec9-659a-495d-ae46-29bfcc131413 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.119465 May 13 13:54:49.563605 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 354/712] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:54:49 2022] POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:54:49.571952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:49.572554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:49.578807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.579251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.580032 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.580857 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.597539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:49.600658 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:49.608563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.609193 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.609995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:49.610457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:49.769590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:49.778415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:49.779940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:49.781111 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8473f19b-a931-49dc-9b2d-9c08ac796208 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.195571 May 13 13:54:49.781668 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 355/713] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:49 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:49.804741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:49.820061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-19c5db84-4aa0-45f5-9739-3b486ef30ac6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1708 microversion: 2.1 time: 0.251880 May 13 13:54:49.820849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 359/714] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:49 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:50.816045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:50.816959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:50.825878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:50.826388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:50.829323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:50.830175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:50.836837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:50.837448 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:50.846657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:50.847512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:50.849512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:50.850313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:51.029830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:51.031045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:51.039264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-19b78580-4545-4a4a-95ad-875b55dd694c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1708 microversion: 2.1 time: 0.206253 May 13 13:54:51.047724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:51.049507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:51.049983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 360/715] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:50 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1708 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:51.051155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ba20b116-fcf5-460d-8bb1-c46568a68e8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.244119 May 13 13:54:51.052940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 356/716] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:50 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:52.059889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:52.061431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:52.068089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:52.068548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:52.069329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:52.069765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:52.071728 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:52.072460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:52.081485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:52.081915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:52.082806 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:52.083910 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:52.225419 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:52.227031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:52.234278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:52.236131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:52.236834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-87c2fd1e-5d35-466b-a3ff-8e40c49cbdcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1712 microversion: 2.1 time: 0.181143 May 13 13:54:52.237544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9aa8d619-16c7-4313-9465-00556e6f39f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.169595 May 13 13:54:52.238142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 361/717] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:54:52 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1712 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:54:52.248712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 357/718] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:52 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:54:53.258091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:53.258682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:53.266421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:53.266934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:53.267713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:53.268145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:53.408865 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:53.417012 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:53.418540 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:53.419857 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-02e4647a-30d0-4957-95fc-d3ad47c8449f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.166866 May 13 13:54:53.420413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 362/719] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:53 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:54.438507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:54.439134 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:54.446433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:54.446930 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:54.447742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:54.448181 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:54.587808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:54.597946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:54.599566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:54.601822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4bea145c-8c00-40f2-abec-2812e95fc4e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.166399 May 13 13:54:54.612067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 358/720] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:54 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:55.619240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:55.619849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:55.626814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:55.627245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:55.628046 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:55.628529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:55.762864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:55.772922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:55.775321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:55.777601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e075f4fb-9419-4640-84c5-cf027f749d4a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.162215 May 13 13:54:55.779598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 363/721] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:55 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:56.798936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:56.799746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:56.807035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:56.807791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:56.808809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:56.809498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:56.956647 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:56.973308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:56.975532 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:56.977144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-72cb12ae-4153-4d0d-b58c-dcb00b6832f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.182317 May 13 13:54:56.978839 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 359/722] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:56 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:58.000782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:58.002656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:58.010743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.011452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.012530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.012966 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.157736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:58.167422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:58.173380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:58.174738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-db7305fb-9a27-4746-a54a-0665ae8d29e8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.181276 May 13 13:54:58.176983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 364/723] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:57 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:54:59.194788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:54:59.195587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:54:59.202703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:59.203149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:59.203948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:59.204389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:59.370239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:59.379751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:59.381778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:54:59.383235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c74b9914-5420-485c-bb79-03e671e690ee tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.193731 May 13 13:54:59.383845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 360/724] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:54:59 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:00.403561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:00.404129 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:00.414108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:00.414727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:00.415885 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:00.416531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:00.556833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:00.565765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:00.567534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:00.568696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b988c6be-24d4-4a87-ac60-6c6298d97746 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.170050 May 13 13:55:00.569257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 365/725] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:00 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:01.591625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:01.592534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:01.601197 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:01.601641 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:01.602448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:01.602877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:01.750754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:01.759169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:01.760639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:01.761782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-96f7be3d-5d2f-4c71-840a-88f817bca9b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.176639 May 13 13:55:01.762505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 361/726] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:01 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:02.780638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:02.781248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:02.788070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:02.788512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:02.789264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:02.789696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:02.928069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:02.936289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:02.937789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:02.938977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b0a445e8-c452-47ce-883b-bb9d345e3c9f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.162585 May 13 13:55:02.939541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 366/727] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:02 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:03.962015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:03.963058 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:03.973404 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:03.973857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:03.974657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:03.975091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:04.114073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:04.122782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:04.124348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:04.125511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a656933c-8bb4-418e-b839-b7d9dffe6c12 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.170197 May 13 13:55:04.126112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 362/728] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:03 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:05.148781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:05.149463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:05.157673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:05.158276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:05.159222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:05.159757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:05.317699 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:05.326581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:05.328468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:05.329873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d511f432-02c4-40ed-9aca-65c082d182ea tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1741 microversion: 2.20 time: 0.186513 May 13 13:55:05.330644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 367/729] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:05 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:05.487488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-aa217f24-6e14-4671-8b14-6b5594548df8 req-948d0b92-c08a-43a7-8388-6048f0caca9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "name": "network-vif-unplugged", "status": "completed", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:05.497111 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-aa217f24-6e14-4671-8b14-6b5594548df8 req-948d0b92-c08a-43a7-8388-6048f0caca9e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:05.497553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-aa217f24-6e14-4671-8b14-6b5594548df8 req-948d0b92-c08a-43a7-8388-6048f0caca9e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:05.508976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-aa217f24-6e14-4671-8b14-6b5594548df8 req-948d0b92-c08a-43a7-8388-6048f0caca9e service nova] Creating event network-vif-unplugged:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:55:05.514372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-aa217f24-6e14-4671-8b14-6b5594548df8 req-948d0b92-c08a-43a7-8388-6048f0caca9e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104400 May 13 13:55:05.515323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 363/730] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:55:06.353592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:06.354644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:06.364266 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:06.364707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:06.365460 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:06.365890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:06.501604 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:06.509459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:06.510954 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:06.512087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dbed482a-d883-486a-b31e-e4d300a6c6fd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1723 microversion: 2.20 time: 0.165910 May 13 13:55:06.512708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 368/731] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:06 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:07.535715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:07.536457 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:07.543695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:07.544175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:07.544983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:07.545442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:07.686376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:07.694453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:07.695974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:07.697125 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-27c3dbb9-4ace-4e28-963a-d3fef6b0cca5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1723 microversion: 2.20 time: 0.168901 May 13 13:55:07.697689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 364/732] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:07 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:08.716858 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:08.717519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:08.724327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:08.724775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:08.725542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:08.725977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:08.867866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:08.886075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:08.887661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:08.888794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-30a33d97-52f4-464d-9f01-a9667f86191b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1666 microversion: 2.20 time: 0.175932 May 13 13:55:08.889496 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 369/733] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:08 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1666 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:08.913843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b7fa370-ae11-4ff1-8a9f-7feaa48e1e5a"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:08.915797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:08.922216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:08.922877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:08.923646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:08.924075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:09.218330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c9def847-35dc-4fc1-bca7-11753aa18941 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308891 May 13 13:55:09.219137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 365/734] 10.222.0.24 () {62 vars in 1363 bytes} [Fri May 13 13:55:08 2022] POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:55:09.340493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:09.341069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:09.347468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:09.347922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:09.349261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:09.349714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:09.548882 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4b596546-7b5d-4dbf-98a2-794e47c0c907 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/action" status: 202 len: 0 microversion: 2.20 time: 0.212244 May 13 13:55:09.549505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 370/735] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 13 13:55:09 2022] POST /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:55:09.558306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:09.559015 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:09.565961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:09.566491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:09.567325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:09.567765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:09.703523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:09.713252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:09.714816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:09.716037 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a3c87f62-35fd-4158-bbbd-2e643cc811a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1752 microversion: 2.20 time: 0.161913 May 13 13:55:09.716799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 366/736] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:09 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:10.739806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:10.741121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:10.747466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:10.747920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:10.748733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:10.749177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:10.895161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:10.904446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:10.905960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:10.907148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-33dd8ce8-555e-4a35-be20-52de0f6ba9a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1754 microversion: 2.20 time: 0.176609 May 13 13:55:10.907736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 371/737] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:10 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:11.926595 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:11.927166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:11.934861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:11.935318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:11.936091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:11.936524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:12.067050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:12.076165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:12.077801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:12.079110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f93fee48-8d1b-489f-8656-0e3b45df7259 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.156685 May 13 13:55:12.079828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 367/738] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:11 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:13.102058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:13.102714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:13.108843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:13.109288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:13.110079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:13.110686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:13.240308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:13.248734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:13.250351 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:13.251608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e52ec4af-d77a-48b8-ae6f-9692e5914a8f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.153605 May 13 13:55:13.252229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 372/739] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:13 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:14.270979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:14.271615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:14.283491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:14.284257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:14.285207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:14.285795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:14.426850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:14.436858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:14.438767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:14.440238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-afc0506c-8dd4-4f21-bd6e-5567e059c1ec tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.173940 May 13 13:55:14.441027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 368/740] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:14 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:15.459666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:15.460789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:15.470603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:15.471186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:15.471992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:15.472422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:15.657238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:15.665586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:15.667094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:15.668202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4cc94967-4845-422f-9b95-7dd9a0d72469 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.212716 May 13 13:55:15.668770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 373/741] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:15 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:16.687070 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:16.687677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:16.694639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:16.695095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:16.695866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:16.696303 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:16.833030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:16.841356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:16.842881 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:16.844044 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-aad4b95a-36fb-48d5-ae5f-078ef66767bd tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.161043 May 13 13:55:16.844601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 369/742] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:16 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:17.862816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:17.863475 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:17.869798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:17.870288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:17.871056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:17.871487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:18.008569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:18.016879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:18.018569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:18.019714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-17a1b783-50a0-45f9-a842-ab481d21ba6e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.160871 May 13 13:55:18.020272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 374/743] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:17 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:19.038852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:19.039536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:19.046335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:19.046869 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:19.047705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:19.048205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:19.183173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:19.191854 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:19.193593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:19.194803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b7ad5dfd-86fb-4f05-ba3c-8b66d605c3ca tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.159994 May 13 13:55:19.196095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 370/744] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:19 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:20.216360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:20.217922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:20.226611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:20.227424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:20.228418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:20.229241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:20.371003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:20.379134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:20.380616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:20.381765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d1c81bd1-626b-42d9-8c9b-ac320e148839 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.170968 May 13 13:55:20.382422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 375/745] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:20 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:21.400750 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:21.401704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:21.410675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:21.411258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:21.412380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:21.413057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:21.556044 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:21.564886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:21.566377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:21.567536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-15290f5b-e324-4219-bfe1-bc24a586619c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.171063 May 13 13:55:21.568091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 371/746] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:21 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:22.590018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:22.591497 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:22.598352 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:22.598835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:22.599616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:22.600050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:22.743672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:22.752711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:22.754220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:22.755372 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b8a6dbe6-abc1-4ce7-8243-4d3c90650870 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.171088 May 13 13:55:22.755923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 376/747] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:22 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:23.774187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:23.774790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:23.782168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:23.782613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:23.783369 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:23.783799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:23.935698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:23.944631 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:23.946098 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:23.947227 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-39be2311-9e19-4bd0-936b-c666e4cbbf39 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.176992 May 13 13:55:23.947819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 372/748] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:23 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:24.966201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:24.966822 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:24.973632 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:24.974074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:24.974860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:24.975299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:25.112470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:25.121561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:25.123079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:25.124249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-305c3e68-f699-4797-ae14-c1c686541972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.162506 May 13 13:55:25.124810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 377/749] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:24 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:26.143677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:26.144290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:26.151173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:26.151621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:26.152714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:26.152859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:26.516650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:26.529148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:26.530676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:26.531843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-28c6668d-fb4b-40c9-b857-87ac267978e2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.392150 May 13 13:55:26.532408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 373/750] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:26 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:27.554698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:27.555681 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:27.565992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:27.566799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:27.568104 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:27.568866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:27.703195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:27.711766 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:27.713254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:27.714455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f4cc2b2c-e9d7-4fe1-963e-6e7fc2d0af05 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.166382 May 13 13:55:27.715042 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 378/751] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:27 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:28.735378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:28.735969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:28.745006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:28.745607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:28.746884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:28.747319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:28.891082 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:28.899776 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:28.901340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:28.902802 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-79baadea-0175-427b-b7fe-7cc140a14977 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.173103 May 13 13:55:28.903357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 374/752] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:28 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:29.926411 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:29.927387 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:29.938090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:29.938836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:29.940088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:29.940797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:30.073479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:30.083204 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:30.085088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:30.086589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9b4c122a-b10d-4f2b-8d8a-5c66d3b03f75 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.166982 May 13 13:55:30.087218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 379/753] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:29 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:31.109656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:31.110282 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:31.116872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:31.117336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:31.118139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:31.118587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:31.257651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:31.266944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:31.268437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:31.269619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-63b98b4d-4b6f-46f1-b265-f5d4a7110b46 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.167086 May 13 13:55:31.270226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 375/754] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:31 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:32.290168 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:32.290771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:32.298892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:32.299343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:32.300107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:32.300542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:32.434338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:32.443605 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:32.445084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:32.446286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d17ae93b-37f5-4df5-92c1-cba2a94b0119 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.160808 May 13 13:55:32.447088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 380/755] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:32 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:33.468616 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:33.469321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:33.477695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:33.478298 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:33.479242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:33.479791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:33.624854 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:33.638857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:33.640347 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:33.641508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-676100da-8225-4e96-8f9f-14147aa5581f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.179171 May 13 13:55:33.642069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 376/756] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:33 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:34.660398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:34.661004 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:34.667434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:34.667879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:34.668609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:34.669058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:34.804356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:34.812818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:34.814349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:34.815502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4d8d87da-e0a6-49ed-8799-a035831b1042 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.159116 May 13 13:55:34.816057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 381/757] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:34 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:35.836207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:35.836963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:35.846640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:35.847240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:35.848263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:35.848843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:35.994331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:36.006721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:36.008944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:36.010759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8ea550ed-7616-4eb4-9717-78a2fc7dcd54 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.179513 May 13 13:55:36.011547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 377/758] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:35 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:37.033094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:37.033746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:37.041258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:37.041785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:37.042729 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:37.043240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:37.178868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:37.188251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:37.189751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:37.190958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-96a43ce5-5da4-445a-a3af-c13ae8a1cbc3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.164588 May 13 13:55:37.191523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 382/759] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:37 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:38.217883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:38.219025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:38.229827 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:38.230631 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:38.231900 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:38.232703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:38.377714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:38.386526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:38.388022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:38.389460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-235811f9-9874-4e3b-a084-e153fe096a74 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.178291 May 13 13:55:38.390025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 378/760] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:38 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:39.409517 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:39.410190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:39.416710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:39.417162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:39.417929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:39.418405 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:39.557098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:39.570596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:39.572580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:39.574433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7023206f-f73a-48cc-99e4-16c974d30fe3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.169468 May 13 13:55:39.575196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 383/761] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:39 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:39.855538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-bf5bd3d3-0f63-4acf-895a-d7ae1ef70a54 req-580b797a-c1d1-4b3e-9e41-cf914ea960ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "name": "network-vif-plugged", "status": "completed", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:39.865107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-bf5bd3d3-0f63-4acf-895a-d7ae1ef70a54 req-580b797a-c1d1-4b3e-9e41-cf914ea960ff service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:39.865617 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-bf5bd3d3-0f63-4acf-895a-d7ae1ef70a54 req-580b797a-c1d1-4b3e-9e41-cf914ea960ff service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:39.878653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-bf5bd3d3-0f63-4acf-895a-d7ae1ef70a54 req-580b797a-c1d1-4b3e-9e41-cf914ea960ff service nova] Creating event network-vif-plugged:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:55:39.883799 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-bf5bd3d3-0f63-4acf-895a-d7ae1ef70a54 req-580b797a-c1d1-4b3e-9e41-cf914ea960ff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 May 13 13:55:39.884843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 379/762] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:55:40.594067 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:40.594749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:40.602573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:40.603277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:40.604485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:40.605122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:40.742145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:40.753259 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:40.754792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:40.755956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e0ab8bc1-9439-44d3-b734-a360f0390f1f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.166472 May 13 13:55:40.756514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 384/763] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:40 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:41.775671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:41.776406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:41.784954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:41.785407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:41.786215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:41.786692 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:41.934279 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:41.943684 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:41.945188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:41.946388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7aad8ff5-ca98-4771-b8cd-480d14c7e7dc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.175431 May 13 13:55:41.946962 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 380/764] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:41 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:42.964870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:42.965470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:42.972126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:42.972580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:42.973342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:42.973808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:43.105917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:43.116065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:43.117721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:43.118888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b29f7763-b8a3-40db-8acd-19a6cdd2dc60 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1810 microversion: 2.20 time: 0.158053 May 13 13:55:43.119450 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 385/765] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:42 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:44.139094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:44.139707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:44.147189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:44.147640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:44.148451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:44.148883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:44.294262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:44.302865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:44.304346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:44.305507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-590d5be7-d405-4108-9c3b-d30f8036e950 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1797 microversion: 2.20 time: 0.170375 May 13 13:55:44.306071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 381/766] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:55:44 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1797 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:55:56.192509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:55:56.194421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 13:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:55:56.980929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d5c80c4-9256-4795-882c-ab954c977702"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:56.982654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:56.993114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:56.993639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:56.994887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:56.995580 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:57.294795 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dc20b832-2620-4b72-ab8c-2986045293b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487743 May 13 13:55:57.295449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 386/767] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 13:55:56 2022] POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:01.436837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:56:01.437762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 13:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:56:04.841484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:04.842544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:04.849324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:04.849778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:04.850593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:04.851018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:04.873742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lazy-loading 'flavor' on Instance uuid 5f63ab4b-27a8-43ab-80d0-85f8088e5523 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:56:05.013374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8043a678-49e7-4dcc-91ad-b68a090b3e71 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/action" status: 200 len: 32 microversion: 2.1 time: 0.175832 May 13 13:56:05.014061 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 382/768] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:56:04 2022] POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:56:05.024336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:05.025066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:05.032195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:05.032836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:05.033706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:05.034371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:05.239816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:05.249656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-360c60bb-116e-4b00-bdc7-fbd696c6adfd tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.230116 May 13 13:56:05.250276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 387/769] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:05 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:06.273527 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:06.274247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:06.281757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:06.282250 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:06.283013 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:06.283445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:06.426602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:06.436378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b555c8ed-d484-48ab-b71d-ea4f2adaeba4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.170584 May 13 13:56:06.436949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 383/770] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:06 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:07.457665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:07.458692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:07.469641 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:07.470452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:07.471729 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:07.472503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:07.608622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:07.622376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e0a5c72-1704-4655-875a-22403bd12b9c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.170775 May 13 13:56:07.623256 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 388/771] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:07 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:08.648045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:08.648990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:08.656771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:08.657221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:08.657986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:08.658452 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:08.795927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:08.804496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c0809445-267f-4f58-a37e-5eddc530a361 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.163027 May 13 13:56:08.805066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 384/772] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:08 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:09.825191 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:09.825928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:09.833761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:09.834341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:09.835217 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:09.836438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:09.975437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:09.987730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-19fcf1e1-a3d7-4c14-8301-b3f4368063b0 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.168056 May 13 13:56:09.988499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 389/773] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:09 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:11.008718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:11.009311 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:11.016402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.016870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:11.017676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.018159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:11.152615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:11.164666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9736d558-e820-4949-98bf-e1adf29ed905 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.159958 May 13 13:56:11.165578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 385/774] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:11 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:11.181982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:56:11.182225 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 13:56:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:56:11.954532 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:11.955138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:11.965573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.966213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:11.967386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.967833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:12.054445 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lazy-loading 'services' on Instance uuid 26fef620-abd7-40d5-a072-6af7a0a22ad0 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:56:12.131764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-47d347a4-b48a-4491-8ea3-74cab1cb2e20 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments/6d0d40ce-0323-42e9-908d-67a6c8e6f7c6" status: 202 len: 0 microversion: 2.1 time: 0.184531 May 13 13:56:12.132351 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 390/775] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 13:56:11 2022] DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments/6d0d40ce-0323-42e9-908d-67a6c8e6f7c6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:56:12.183232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:12.183915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:12.192472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:12.192927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:12.193792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:12.194387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:12.336489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:12.345216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-451ada73-caec-4ce0-9322-0c18e0db52b7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.166370 May 13 13:56:12.345762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 386/776] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:12 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:13.254811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-69da20a7-37f6-4ca4-adbb-cfa29253f725 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:13.261416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69da20a7-37f6-4ca4-adbb-cfa29253f725 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.261866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69da20a7-37f6-4ca4-adbb-cfa29253f725 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.285789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-69da20a7-37f6-4ca4-adbb-cfa29253f725 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Going to try to stop instance {{(pid=123955) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:56:13.333068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-69da20a7-37f6-4ca4-adbb-cfa29253f725 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.082805 May 13 13:56:13.333663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 391/777] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:56:13 2022] POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:56:13.341941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:13.342609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:13.349748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.350389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.351291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.351734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.362690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:13.363486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:13.370237 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.370914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.371701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.372622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.490871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:13.498710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ba596cce-c86a-4b6e-ba78-98ba74799d87 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.160671 May 13 13:56:13.499276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 387/778] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:13 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:13.506017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:13.515088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ab2b1fd1-5605-4852-a444-d1b2a9f99de3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.156736 May 13 13:56:13.515639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 392/779] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:13 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:14.520573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:14.521528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:14.530477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:14.530922 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:14.531694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:14.532127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:14.533354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:14.533963 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:14.540577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:14.541029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:14.541825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:14.542307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:14.661038 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:14.668984 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e377ed86-9872-4d3d-8bc6-9e62777d7e97 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.155147 May 13 13:56:14.669585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 388/780] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:14 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:14.670616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:14.678777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7e23feb7-cf15-46f7-bcda-3492f5466956 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.149681 May 13 13:56:14.679358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 393/781] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:14 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:15.687374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:15.688025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:15.695035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.695481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.696286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.696718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.697388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:15.698349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:15.704838 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.705442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.706367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.707055 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.852371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:15.861440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-33fd348c-4adb-4e6b-bef6-f6383a2c90c5 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.178174 May 13 13:56:15.862031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 389/782] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:15 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:16.040087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:16.051324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cfa63d33-417f-4276-a873-1b76bbb6244d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.358557 May 13 13:56:16.051873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 394/783] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:15 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:16.880569 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:16.881119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:16.888057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.888509 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:16.889281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.889716 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:17.021405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:17.030318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f71bdb0c-c633-40b0-b2ed-bd857c669419 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.153666 May 13 13:56:17.030855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 390/784] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:16 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:17.072151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:17.072730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:17.079828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:17.080276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:17.081045 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:17.081476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:17.225989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:17.235924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f885389e-44a5-4c9a-9aeb-2a9417492575 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.169896 May 13 13:56:17.236469 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 395/785] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:17 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:18.057011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:18.058226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:18.068990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.069741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.071102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.071819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.213515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:18.222105 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cdfcb0a8-657e-4e69-a658-0851715a4fcd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.171768 May 13 13:56:18.222699 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 391/786] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:18 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:18.252839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:18.253476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:18.260246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.260767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.261531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.261970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.394248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:18.402124 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-43a96d68-f418-4837-bc38-d6c1fe3583ac tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.153187 May 13 13:56:18.402713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 396/787] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:18 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:19.246724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:19.247376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:19.254238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.254815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.255720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.256253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.400453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:19.412927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-439945a3-c08f-49d0-b3dd-2c699fc786b9 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.170924 May 13 13:56:19.413678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 392/788] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:19 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:19.424704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:19.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:19.431714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.432164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.433023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.433523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.566431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:19.576858 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b0d9a6ff-2e9b-497f-9226-e85d13aaab76 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.155995 May 13 13:56:19.577373 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 397/789] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:19 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:20.434091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:20.434918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:20.443570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.444165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.445176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.445751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.584543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:20.592842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-65d2fc6d-10e2-442f-8e51-d0b07765af07 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.163875 May 13 13:56:20.593758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 393/790] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:20 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:20.598749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:20.599350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:20.605896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.606379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.607137 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.607569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.743582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:20.751448 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b5eb0dc1-c5cf-4abb-a165-a86c486c75fc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1733 microversion: 2.1 time: 0.156661 May 13 13:56:20.752037 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 398/791] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:20 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:21.617099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:21.618086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:21.629477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.630309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.631582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.632352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.768711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:21.769617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:21.776132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.776590 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.777444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.777920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.780345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:21.788496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0d6c87ec-cd46-4f7b-9870-5b9dcc983cfe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.177922 May 13 13:56:21.789282 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 394/792] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:21 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:21.904386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:21.913359 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6c768ea7-fa41-4239-a1f1-faf7213de9e3 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1713 microversion: 2.1 time: 0.148501 May 13 13:56:21.913935 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 399/793] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:21 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:21.969199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:21.969697 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:21.976562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.977021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.977793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.978272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.061491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] HTTP exception thrown: Cannot 'detach_volume' instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 while it is in vm_state rescued May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Request method failure captured: May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments/2d5c80c4-9256-4795-882c-ab954c977702 HTTP/1.1 May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHmoYcXdpLJ0mvorCl5JvtXnQvdvSc0qcaI5DOYf55NIuNJ8Oy6IGOmr5HmQO94HqnEmCd2US9nN2h0c5MKlvfDiCH7Ht1lFA30TWE7YckEcEgOiEI_xGSE6LctKDV1baE2Ay0dNvSQfiWeikOMp886N_OE-nsmDBQWBo_Z1Bv_raQ May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:56:22.063169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f9ca490113764eba85daa6ca9fbba5f5 May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:56:22.064710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Cannot 'detach_volume' instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 while it is in vm_state rescued May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'server_id': '5f63ab4b-27a8-43ab-80d0-85f8088e5523', 'id': '2d5c80c4-9256-4795-882c-ab954c977702'} May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:56:22.065415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 while it is in vm_state rescued May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 while it is in vm_state rescued May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:56:22.066710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Returning 409 to user: Cannot 'detach_volume' instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 while it is in vm_state rescued {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:56:22.067678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-62e4ea5b-fa20-4a19-85c6-159e35d862b2 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments/2d5c80c4-9256-4795-882c-ab954c977702" status: 409 len: 152 microversion: 2.1 time: 0.099504 May 13 13:56:22.067678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 395/794] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 13:56:21 2022] DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments/2d5c80c4-9256-4795-882c-ab954c977702 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:56:22.074029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:22.074581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:22.080762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.081211 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.081974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.082455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.168446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c6d4a39e-29fd-4078-9ce8-772aab8a705d tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/action" status: 202 len: 0 microversion: 2.1 time: 0.098291 May 13 13:56:22.168974 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 400/795] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:56:22 2022] POST /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:56:22.178924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:22.179555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:22.185642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.186179 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.186952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.187381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.319590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:22.328076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1b428484-3acc-4c98-ac98-3ee39ea13d83 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1721 microversion: 2.1 time: 0.152965 May 13 13:56:22.328652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 396/796] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:22 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:22.810484 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:22.811173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:22.817862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.818334 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.819110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.819548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.950834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:22.961777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4c5b6d3f-e969-419c-99ec-44fe9a787e8e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.157954 May 13 13:56:22.962653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 401/797] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:22 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:23.349054 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:23.350221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:23.359146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:23.359670 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:23.360443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:23.360874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:23.508526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:23.520884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-20046da7-4737-4af3-8f43-bb4be3cfd078 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1721 microversion: 2.1 time: 0.177950 May 13 13:56:23.521701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 397/798] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:23 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:23.989257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:23.990421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:24.000918 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.001620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.002885 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.003636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.154253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:24.161991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5ef27714-ea13-4a9b-bd29-44a10f77de95 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.179302 May 13 13:56:24.162579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 402/799] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:23 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:24.545536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:24.546522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:24.555780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.556363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.557441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.557943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.700609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:24.708713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c9ff1444-f4a4-4524-91e2-bd1855c1f7dc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1721 microversion: 2.1 time: 0.169946 May 13 13:56:24.709580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 398/800] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:24 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:25.183636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:25.184989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:25.192006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.192497 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:25.193392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.193872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:25.333110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:25.340558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bde2cf6d-42dd-485f-a99f-2447e9b2a2c8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.163819 May 13 13:56:25.341097 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 403/801] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:25 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:25.728768 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:25.729467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:25.737469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.738001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:25.738972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.739488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:25.876485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:25.884852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c33c5599-eb5a-40d7-b86c-0f63add3f800 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1727 microversion: 2.1 time: 0.160618 May 13 13:56:25.885384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 399/802] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:25 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:25.901728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:25.902285 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:25.909419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.909870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:25.910684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:25.911156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:26.001024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4262f7ea-cac8-455d-ab7f-3134bf66c3e5 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103133 May 13 13:56:26.001617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 404/803] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 13:56:25 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:26.360100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:26.360651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:26.367110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:26.367715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:26.368476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:26.368941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:26.666203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:26.674245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b4a2cf5a-6c97-4574-ba6c-2ea2e1a3e3e2 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.318256 May 13 13:56:26.675118 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 400/804] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:26 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:27.242288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-a7f72dd9-2243-4d44-a0d0-cdf9dc281688 req-da207405-f181-4d1c-9dda-b4a85ddd81e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:27.251051 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a7f72dd9-2243-4d44-a0d0-cdf9dc281688 req-da207405-f181-4d1c-9dda-b4a85ddd81e4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.251491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a7f72dd9-2243-4d44-a0d0-cdf9dc281688 req-da207405-f181-4d1c-9dda-b4a85ddd81e4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.262772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-a7f72dd9-2243-4d44-a0d0-cdf9dc281688 req-da207405-f181-4d1c-9dda-b4a85ddd81e4 service nova] Creating event network-changed:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:56:27.268023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-a7f72dd9-2243-4d44-a0d0-cdf9dc281688 req-da207405-f181-4d1c-9dda-b4a85ddd81e4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084692 May 13 13:56:27.268691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 405/805] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:27.691857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:27.693176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:27.700373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.701132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.701915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.702382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.836213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:27.844871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-106343ed-279c-481d-bdfb-b62326598129 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.156850 May 13 13:56:27.845542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 401/806] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:27 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:28.868649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:28.869797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:28.877430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.877807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.878627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.879060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:29.024642 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.034784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-31008c0a-7963-4754-90f8-399969016c54 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.173715 May 13 13:56:29.035673 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 406/807] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:28 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:29.284225 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-c4646537-dc08-4ea3-998f-c8748168f1ea req-2b85c245-45a5-41c8-980a-ccfc43ff4cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:29.293263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-c4646537-dc08-4ea3-998f-c8748168f1ea req-2b85c245-45a5-41c8-980a-ccfc43ff4cff service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:29.293946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-c4646537-dc08-4ea3-998f-c8748168f1ea req-2b85c245-45a5-41c8-980a-ccfc43ff4cff service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:29.305127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-c4646537-dc08-4ea3-998f-c8748168f1ea req-2b85c245-45a5-41c8-980a-ccfc43ff4cff service nova] Creating event network-changed:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:56:29.310608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-c4646537-dc08-4ea3-998f-c8748168f1ea req-2b85c245-45a5-41c8-980a-ccfc43ff4cff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030444 May 13 13:56:29.311243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 402/808] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:30.059843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:30.061098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:30.071849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.072602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:30.073938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.075109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:30.225178 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:30.237073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-98c696c4-35a3-4f80-8b52-2910befa92ae tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1676 microversion: 2.1 time: 0.183538 May 13 13:56:30.237804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 407/809] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:30 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:31.262642 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:31.263703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:31.270525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.270947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.271717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.272181 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.417455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:31.426647 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c393e1ae-3b3f-4f8a-8bef-6bcd410a190a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1653 microversion: 2.1 time: 0.171840 May 13 13:56:31.427235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 403/810] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:31 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1653 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:31.443386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5b56d798-67e7-4a28-b514-b6fc99f8b8cb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:31.450490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5b56d798-67e7-4a28-b514-b6fc99f8b8cb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.450943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5b56d798-67e7-4a28-b514-b6fc99f8b8cb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.473623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5b56d798-67e7-4a28-b514-b6fc99f8b8cb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Going to try to start instance {{(pid=123955) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:56:31.525783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5b56d798-67e7-4a28-b514-b6fc99f8b8cb tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.085417 May 13 13:56:31.526514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 408/811] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:56:31 2022] POST /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:56:31.536979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:31.537535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:31.543732 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.544196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.545091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.545535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.679665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:31.687656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8115e4af-f446-41ae-a2e0-97fb65addb26 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1662 microversion: 2.1 time: 0.155755 May 13 13:56:31.688239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 404/812] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:31 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:32.709354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:32.710386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:32.720107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.720564 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.721338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.721773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.869618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:32.880870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-72e9ce83-3d58-4853-8d85-fee810f7723e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1662 microversion: 2.1 time: 0.178048 May 13 13:56:32.881613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 409/813] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:32 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:33.903371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:33.904368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:33.912131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.912582 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.913356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.913789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.050710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.058590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c482b3a4-5569-4d66-94a6-1384fac41b16 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1666 microversion: 2.1 time: 0.161842 May 13 13:56:34.059138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 405/814] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:33 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:51.559324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:51.559946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:51.566634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.567087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.567855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.568295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.597428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9f407fb7-b3b3-4894-bd1c-1887b8f13b47 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments/2b7fa370-ae11-4ff1-8a9f-7feaa48e1e5a" status: 200 len: 194 microversion: 2.20 time: 0.042307 May 13 13:56:51.597996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 410/815] 10.222.0.24 () {60 vars in 1453 bytes} [Fri May 13 13:56:51 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments/2b7fa370-ae11-4ff1-8a9f-7feaa48e1e5a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:56:51.665738 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:51.666291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:51.672431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.672876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.673645 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.674164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.756888 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lazy-loading 'services' on Instance uuid 37444ba4-a1cb-48d8-adbf-8f58200aba40 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:56:51.836657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f9c924e2-ba2e-4bf5-8ff6-9c54fced65b2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments/2b7fa370-ae11-4ff1-8a9f-7feaa48e1e5a" status: 202 len: 0 microversion: 2.20 time: 0.174819 May 13 13:56:51.837599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 406/816] 10.222.0.24 () {60 vars in 1456 bytes} [Fri May 13 13:56:51 2022] DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments/2b7fa370-ae11-4ff1-8a9f-7feaa48e1e5a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 13:56:51.846693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:51.847622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:51.854376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.854988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.855998 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.856601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.888536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-720cca1d-de8f-425c-95ae-99bd43cec184 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045873 May 13 13:56:51.889102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 411/817] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 13 13:56:51 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:56:52.902720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:52.903833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:52.911174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.911610 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.912371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.912801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.942189 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-55693cff-1b64-4426-86de-3c5c0e06025f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044477 May 13 13:56:52.942733 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 407/818] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 13 13:56:52 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:56:53.958520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.960061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.971643 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.972396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.973676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.974463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.008257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c353a2ca-c0a7-4388-809d-9de43ce26340 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056409 May 13 13:56:54.008849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 412/819] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:54.067397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.067938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.074743 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.075188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.075949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.076379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.102703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:56:54.197710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2f9a2699-d0ad-4be5-84df-610a16793a0a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 204 len: 0 microversion: 2.20 time: 0.133804 May 13 13:56:54.198615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 408/820] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 13 13:56:54 2022] DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:56:54.207049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.207656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.214144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.214595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.215355 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.215783 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.351751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.360094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.361769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.362970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a8a3c046-e2b0-46e9-8775-251b1ba13aa9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.159843 May 13 13:56:54.363535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 413/821] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:56:54 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:55.388414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:55.389523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:55.400288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.400731 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.401500 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.401912 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.536246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.545103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.546650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.547928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a43bd433-e357-4554-bd29-3cfd0a3c4d8c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.166861 May 13 13:56:55.548479 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 409/822] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:56:55 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:56.567144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:56.567703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:56.574624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.575071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.575849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.576285 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.014774 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.015232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.021366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.021814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.022626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.023057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.029142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.038030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.039845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.041260 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-82ccc21b-2f6c-490e-a945-46aa7b0bd5a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1725 microversion: 2.20 time: 0.478260 May 13 13:56:57.042535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 414/823] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:56:56 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1725 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:57.049162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:56:57.125620 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-93847d25-687c-4291-bb3e-ec6e363152f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "DELETE /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 204 len: 0 microversion: 2.1 time: 0.222477 May 13 13:56:57.126561 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 410/824] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:56:56 2022] DELETE /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:56:57.135584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.136197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.146424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.146874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.147818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.148264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.375442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.383734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-93afb190-cf18-4dc2-a7c2-48a8cc7b2a6c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1578 microversion: 2.1 time: 0.252583 May 13 13:56:57.393678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 415/825] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:57.619235 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-11a03553-5182-44a6-9932-7727ae0acfbb req-a9c67788-9291-44be-a4e5-a0168db56ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37444ba4-a1cb-48d8-adbf-8f58200aba40", "name": "network-vif-deleted", "tag": "20d2d4db-c896-4635-a117-7052bf975b9a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:57.628820 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-11a03553-5182-44a6-9932-7727ae0acfbb req-a9c67788-9291-44be-a4e5-a0168db56ec5 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.628820 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-11a03553-5182-44a6-9932-7727ae0acfbb req-a9c67788-9291-44be-a4e5-a0168db56ec5 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.638873 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-11a03553-5182-44a6-9932-7727ae0acfbb req-a9c67788-9291-44be-a4e5-a0168db56ec5 service nova] Creating event network-vif-deleted:20d2d4db-c896-4635-a117-7052bf975b9a for instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 on hv-cinder-79578 May 13 13:56:57.644506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-11a03553-5182-44a6-9932-7727ae0acfbb req-a9c67788-9291-44be-a4e5-a0168db56ec5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029246 May 13 13:56:57.645305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 411/826] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:58.059731 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.060501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.066811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.067371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.068273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.068805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.136806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.145689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.147107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.148354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c1cca12e-c973-4ce8-b3f4-de7ced638990 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1657 microversion: 2.20 time: 0.092492 May 13 13:56:58.149214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 416/827] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:58.402830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.403400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.411764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.412603 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.413626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.414321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.584790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.593325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b6381e74-94fd-4ed6-82e5-f5421eac8b0f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1578 microversion: 2.1 time: 0.195836 May 13 13:56:58.599172 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 412/828] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:59.168129 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.168720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:59.175077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.175522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.176290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.176721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.212189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.212955 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.213415 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lazy-loading 'fault' on Instance uuid 37444ba4-a1cb-48d8-adbf-8f58200aba40 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:56:59.255624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.264158 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.265631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.266933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b7a14f7c-bbb4-4747-92ae-bbf16c34d8f5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 200 len: 1371 microversion: 2.20 time: 0.103086 May 13 13:56:59.267479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 417/829] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:59.611542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.612167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:59.620600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.621049 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.621842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.622317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.772856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.781758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-47c37322-9d8e-4d86-ab08-86a43103ecd7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1578 microversion: 2.1 time: 0.174126 May 13 13:56:59.782593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 413/830] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:00.191657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-7d660aaf-6342-4130-b167-97b75bb691f1 req-887d3326-c856-46a6-826e-1305e1d93118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2efb78-1e20-4245-99cc-bbe58cb016d3", "name": "network-vif-deleted", "tag": "194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:00.202227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-7d660aaf-6342-4130-b167-97b75bb691f1 req-887d3326-c856-46a6-826e-1305e1d93118 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.202666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-7d660aaf-6342-4130-b167-97b75bb691f1 req-887d3326-c856-46a6-826e-1305e1d93118 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.215019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-7d660aaf-6342-4130-b167-97b75bb691f1 req-887d3326-c856-46a6-826e-1305e1d93118 service nova] Creating event network-vif-deleted:194a9e2e-4cd0-4f52-acc5-4c6e05fe11a5 for instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 on hv-cinder-79578 May 13 13:57:00.220513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-7d660aaf-6342-4130-b167-97b75bb691f1 req-887d3326-c856-46a6-826e-1305e1d93118 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 May 13 13:57:00.221152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 418/831] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:00.285877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.286627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.296014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.296553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.297440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.297878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.311811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 HTTP/1.1 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:00.313472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 13:57:00.315261 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '37444ba4-a1cb-48d8-adbf-8f58200aba40'} May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:00.316207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 13:57:00.318397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:00.319765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:00.319765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7b8b7dfd-6b63-4e98-9267-6d55cd522c7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 404 len: 111 microversion: 2.20 time: 0.033297 May 13 13:57:00.319765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 414/832] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:57:00.325741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-520eb46b-22d0-4941-9c76-506d7af85883 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '.version_select at 0x7ff1542fb8b0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.349646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-520eb46b-22d0-4941-9c76-506d7af85883 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929469743" status: 204 len: 0 microversion: 2.20 time: 0.028452 May 13 13:57:00.350254 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 419/833] 10.222.0.24 () {60 vars in 1261 bytes} [Fri May 13 13:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929469743 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:57:00.800162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.800919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.809204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.809848 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.811137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.811738 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.846864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.847309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.847754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lazy-loading 'fault' on Instance uuid dd2efb78-1e20-4245-99cc-bbe58cb016d3 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:00.913000 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:00.923170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-37e694a7-7c85-4661-801f-896c292884f5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 200 len: 1230 microversion: 2.1 time: 0.127918 May 13 13:57:00.924276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 415/834] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:01.105604 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6c23b30b-8c39-4c10-80fb-9561aa0414a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: .version_select at 0x7ff15912ddc0>, body: {"keypair": {"name": "tempest-keypair-399638959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoqg9UJ43NEYhu07F6jewfEaIYLmzk3EqzjyPWYKwcmg68ko+mLFlbW2RiV+lVXy3xmSEcgpPL5EyyC85otpM/SS4WZrAjVFNmxOhpRMPLQM0U9JJIP5tDKLRFkPyBStQ=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:01.125612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-6c23b30b-8c39-4c10-80fb-9561aa0414a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:01.131501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-6c23b30b-8c39-4c10-80fb-9561aa0414a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for user 35c45393e3054bc3a1417fc23e721853 and project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:01.163916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6c23b30b-8c39-4c10-80fb-9561aa0414a5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.062782 May 13 13:57:01.170608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 420/835] 10.222.0.24 () {62 vars in 1199 bytes} [Fri May 13 13:57:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 13 13:57:01.941018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:01.941621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:01.948197 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.948621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.949374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.949813 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.963439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] HTTP exception thrown: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Request method failure captured: May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 HTTP/1.1 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmJusgGc9RN5Z1vrUktnPHSASBacGAkXCu3ysmOX-E7typOT2S3N72_9OeUhR6ome_uufc9kOzBahqe1nhkYM5AjNJMCkhjMJWdRAHmNipRZWKN3gq5qEWazTnqQfDwEJh9V1RdXbisQnMyrI7lAWaNwdTtpVBOg811isE75KN3cm7M May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 5f52886f21f64392889649d64be8b3d3 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestVolumeBootPattern-681955838 May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:01.965160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f52886f21f64392889649d64be8b3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestVolumeBootPattern-681955838 May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 5f52886f21f64392889649d64be8b3d3 May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestVolumeBootPattern-681955838 May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestVolumeBootPattern-681955838-project May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 1554793dc7934f9889da636263301ecf May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestVolumeBootPattern-681955838-project May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 13:57:01.966825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'dd2efb78-1e20-4245-99cc-bbe58cb016d3'} May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:01.968050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 13:57:01.969542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:01.970865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Returning 404 to user: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:01.970865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-26d0462b-fa4b-4529-9464-da1e1ee04ba3 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 404 len: 111 microversion: 2.1 time: 0.029569 May 13 13:57:01.970865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 416/836] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:01 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:02.022943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226150891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1285115109", "security_groups": [{"name": "tempest-secgroup-smoke-1880576344"}], "block_device_mapping_v2": [{"uuid": "0253f0d4-2d86-4405-8352-df2d841fa409", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f881359-87c3-427b-a40c-bc9875a283dd"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:02.141151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] validate_networks() for [('9f881359-87c3-427b-a40c-bc9875a283dd', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:57:02.485723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2008683722", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18373f82-18bd-4634-b9ff-f547598d414b"}], "security_groups": [{"name": "tempest-securitygroup--1793755902"}], "key_name": "tempest-keypair-399638959", "user_data": "}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:02.509051 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:57:02.509459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:57:02.509920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:57:02.510345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:57:02.510985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:57:02.519772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.520210 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.520992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.521418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.538930 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:02.543671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for user 1554793dc7934f9889da636263301ecf and project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:02.598154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] validate_networks() for [('18373f82-18bd-4634-b9ff-f547598d414b', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:57:02.601661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:57:02.603911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0253f0d4-2d86-4405-8352-df2d841fa409',volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:57:02.741730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-25c366a2-0e86-408a-824d-9217216baa1a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723393 May 13 13:57:02.742839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 421/837] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:57:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:57:02.752631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-652bdbfe-3609-4e60-a342-2f16e9e188f1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:02.753234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-652bdbfe-3609-4e60-a342-2f16e9e188f1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:02.822945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-652bdbfe-3609-4e60-a342-2f16e9e188f1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:02.830076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-652bdbfe-3609-4e60-a342-2f16e9e188f1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1095 microversion: 2.1 time: 0.081217 May 13 13:57:02.830903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 422/838] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:02 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:03.314129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:57:03.314625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:57:03.315001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:57:03.315729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:57:03.316146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:57:03.326398 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.326855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.327660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.328115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.345577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:03.349749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Getting quotas for user 35c45393e3054bc3a1417fc23e721853 and project 1a565cd1f4c84527bc91fceaff6c5689. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:03.361257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:57:03.363604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:57:03.415534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9779dac8-1da7-4936-b69a-a8aec243f001 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.934042 May 13 13:57:03.416334 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 417/839] 10.222.0.24 () {62 vars in 1187 bytes} [Fri May 13 13:57:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 13 13:57:03.426807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:03.427576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:03.484597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.491752 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.493755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.494909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a165cbd-8793-46a0-a833-765debc17e93 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1281 microversion: 2.20 time: 0.072119 May 13 13:57:03.495515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 423/840] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:03 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:03.847377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:03.848460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:03.855676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.856515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.858872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.859880 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.937315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.945212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-dfbe2f07-132e-46f2-9f7b-57c17d548f5f tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1211 microversion: 2.1 time: 0.101873 May 13 13:57:03.945795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 418/841] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:03 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:04.513449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.514100 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.522197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.523148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.524434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.525132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.618698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.628390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.630542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.632128 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f0e7ad42-8255-46ed-91ad-8a7c7707dd3a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1341 microversion: 2.20 time: 0.123017 May 13 13:57:04.644389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 424/842] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1341 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:04.962991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.963650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.984066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.984927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.986023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.986961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.217210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.231802 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-aaf83358-5e0f-4e5e-9b08-4db26739464b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.272650 May 13 13:57:05.232823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 419/843] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:05.653679 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:05.654366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:05.661764 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.662302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.663044 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.663544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.732091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-ef5fa2fc-c697-4b40-8cd0-5ee7882ee181 req-431d6df6-9b02-418d-9f64-24109d9ef68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f0ae3e-2ace-4327-bc72-93aaf6885296", "tag": "a33ac3fe-cf89-428e-8740-85843d8438ac"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:05.754969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-ef5fa2fc-c697-4b40-8cd0-5ee7882ee181 req-431d6df6-9b02-418d-9f64-24109d9ef68c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.755698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-ef5fa2fc-c697-4b40-8cd0-5ee7882ee181 req-431d6df6-9b02-418d-9f64-24109d9ef68c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.780503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-ef5fa2fc-c697-4b40-8cd0-5ee7882ee181 req-431d6df6-9b02-418d-9f64-24109d9ef68c service nova] Creating event network-changed:a33ac3fe-cf89-428e-8740-85843d8438ac for instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 on hv-cinder-79578 May 13 13:57:05.789182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-ef5fa2fc-c697-4b40-8cd0-5ee7882ee181 req-431d6df6-9b02-418d-9f64-24109d9ef68c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064211 May 13 13:57:05.792115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 420/844] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:05.941404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.950298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.952121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.953478 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0f246a22-9479-4fb9-9b6e-3fdaa2a933a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.306624 May 13 13:57:05.955609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 425/845] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:05 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:06.249571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.250906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.258339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.259100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.260115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.260747 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.387554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-a8cc99ce-04f5-4f49-96b0-e73e854f79a7 req-a101f6a1-ecb6-4931-97d0-aea937f5b618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:06.397713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a8cc99ce-04f5-4f49-96b0-e73e854f79a7 req-a101f6a1-ecb6-4931-97d0-aea937f5b618 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.398218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a8cc99ce-04f5-4f49-96b0-e73e854f79a7 req-a101f6a1-ecb6-4931-97d0-aea937f5b618 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.410793 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-a8cc99ce-04f5-4f49-96b0-e73e854f79a7 req-a101f6a1-ecb6-4931-97d0-aea937f5b618 service nova] Creating event network-changed:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 13:57:06.416856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-a8cc99ce-04f5-4f49-96b0-e73e854f79a7 req-a101f6a1-ecb6-4931-97d0-aea937f5b618 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034655 May 13 13:57:06.417710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 426/846] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:06.470130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:06.478524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b39be5e5-0fe2-44c8-b832-5aa3918a1c33 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.232635 May 13 13:57:06.479117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 421/847] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:06.978633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.979390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.986686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.987167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.987978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.988505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.132739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.141110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.142631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.143731 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f6a0d4d9-f8b3-49af-adbb-059aef39be49 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.172493 May 13 13:57:07.144295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 427/848] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:07.495979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:07.496601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:07.503845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.504285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.505051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.505476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.720990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.728965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3fd4f3c3-9785-4efa-9278-4442a21dea01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.237362 May 13 13:57:07.729572 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 422/849] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:07 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:08.166105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:08.166718 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:08.173298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.173742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.174554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.174999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.316687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.325295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.326836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.327906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8348c408-4604-4e53-beac-5d464dcb9aa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.168207 May 13 13:57:08.328463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 428/850] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:08 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:57:08.746319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:08.746933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:08.753786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.754276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.755045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.755483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.902936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.915550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68e2d754-30ee-4b64-91d5-c1c0752cb4d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.173030 May 13 13:57:08.916117 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 423/851] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:08 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:09.346381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:09.346989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:09.354343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.354794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.355566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.355997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.489057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.497589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.499123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.500235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bf033ccb-fdec-4eff-bc57-6a2f34196271 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.158036 May 13 13:57:09.500820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 429/852] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:09 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:09.936826 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:09.937831 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:09.948284 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.948740 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.949518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.949958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.096191 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.108147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b38b7e19-d499-4457-9753-9e361fa1faa4 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.178035 May 13 13:57:10.109006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 424/853] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:09 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:10.518066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:10.518666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:10.525374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.525812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.526594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.527020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.664838 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.673762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.675308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.676419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3702d993-aee7-4b74-ac1e-32bae7919e3b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.162446 May 13 13:57:10.677007 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 430/854] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:10 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:11.125954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:11.126640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:11.134007 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.134491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.135265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.135701 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.282815 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.291635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68447789-e490-458f-a8d9-ed165eba27bf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.169764 May 13 13:57:11.292222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 425/855] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:11 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:11.699801 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:11.700411 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:11.707231 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.707685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.708467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.708887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.844941 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.853623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.859763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.860906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-06b5574a-d4fc-499d-840c-4e4673ce2511 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.165645 May 13 13:57:11.861478 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 431/856] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:11 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:12.309733 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:12.310392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:12.316529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.316993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.317758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.318252 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.456675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:12.464290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6dbfbba7-d701-448b-a393-83002252d6dd tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.159454 May 13 13:57:12.464832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 426/857] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:12 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:12.880005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:12.881191 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:12.888070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.888512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.889357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.889671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.024878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.033926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.035435 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.036578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cedcd410-3fc9-4713-adc2-01f596bc3de8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.160568 May 13 13:57:13.037148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 432/858] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:12 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:13.483834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:13.484554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:13.492914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:13.493470 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.494459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:13.495066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.627987 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.636246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1a6dcf72-acaf-4bfc-91d6-dc8c3618ab56 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.157883 May 13 13:57:13.636786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 427/859] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:13 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:14.058804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:14.059383 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:14.066546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.067025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.067833 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.068303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.202288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.210176 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.211646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.212758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7d50e61d-2d80-4c7e-a450-99fe5ef4363a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.160120 May 13 13:57:14.214268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 433/860] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:14 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:14.422681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-b715d180-14a2-4117-ac25-9c376ea07ea9 req-82717771-be19-4c65-b55f-0fc6e624d881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "name": "network-vif-plugged", "status": "completed", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:14.433599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-b715d180-14a2-4117-ac25-9c376ea07ea9 req-82717771-be19-4c65-b55f-0fc6e624d881 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.434122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-b715d180-14a2-4117-ac25-9c376ea07ea9 req-82717771-be19-4c65-b55f-0fc6e624d881 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.446529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-b715d180-14a2-4117-ac25-9c376ea07ea9 req-82717771-be19-4c65-b55f-0fc6e624d881 service nova] Creating event network-vif-plugged:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 13:57:14.452427 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-b715d180-14a2-4117-ac25-9c376ea07ea9 req-82717771-be19-4c65-b55f-0fc6e624d881 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033933 May 13 13:57:14.453365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 428/861] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:14.653488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:14.653989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:14.660809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.661252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.662021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.662481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.818468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.826743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3009b97d-95d2-4df3-8b09-e54fb9a62f08 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.177297 May 13 13:57:14.827369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 434/862] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:14 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:15.231584 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:15.232308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:15.238601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.239045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.239817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.240224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.372073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.380320 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.381819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.382964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bd54ac12-acc4-48b8-acc9-25cfd714f1f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.155840 May 13 13:57:15.383511 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 429/863] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:15 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:15.845643 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:15.846344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:15.855244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.855707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.856465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.856914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.003267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:16.016682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-973d8e7a-693d-4e4f-baf5-4fe6e7fa1c9e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.175901 May 13 13:57:16.017446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 435/864] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:15 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:16.401712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:16.402767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:16.410483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.410936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.411736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.412170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.473617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-cb6f2f4d-73cf-4cbc-abc0-8b659f61017b req-88dca5bb-bfdf-4a0a-ad5c-5e1473d1e771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f0ae3e-2ace-4327-bc72-93aaf6885296", "name": "network-vif-plugged", "status": "completed", "tag": "a33ac3fe-cf89-428e-8740-85843d8438ac"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:16.486606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-cb6f2f4d-73cf-4cbc-abc0-8b659f61017b req-88dca5bb-bfdf-4a0a-ad5c-5e1473d1e771 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.487419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-cb6f2f4d-73cf-4cbc-abc0-8b659f61017b req-88dca5bb-bfdf-4a0a-ad5c-5e1473d1e771 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.500660 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-cb6f2f4d-73cf-4cbc-abc0-8b659f61017b req-88dca5bb-bfdf-4a0a-ad5c-5e1473d1e771 service nova] Creating event network-vif-plugged:a33ac3fe-cf89-428e-8740-85843d8438ac for instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 on hv-cinder-79578 May 13 13:57:16.514613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-cb6f2f4d-73cf-4cbc-abc0-8b659f61017b req-88dca5bb-bfdf-4a0a-ad5c-5e1473d1e771 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040670 May 13 13:57:16.515564 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 436/865] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:16.564581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:16.573315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:16.575133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:16.576280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-64c87b24-359e-4a76-848a-d5146a547db1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1407 microversion: 2.20 time: 0.178620 May 13 13:57:16.577077 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 430/866] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:16 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:17.040114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:17.040789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:17.048229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.048775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.049879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.050375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.204483 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.212019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-157a7a16-65cc-456e-bc4d-e2e7b6ea68a0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.178388 May 13 13:57:17.212588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 437/867] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:17 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:17.600128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:17.601201 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:17.612063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.612800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.614114 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.615104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.762175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.770950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.772449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.773659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0481ba93-635b-46c0-9f5e-f9b1a5c0a445 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1599 microversion: 2.20 time: 0.180201 May 13 13:57:17.779403 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 431/868] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:57:17 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:17.791656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:17.792177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:17.798544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.798991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.799753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.800196 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.884575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ac3ebba8-7cc8-4634-bfd9-a1c3d1306414 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096818 May 13 13:57:17.885182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 438/869] 10.222.0.24 () {60 vars in 1315 bytes} [Fri May 13 13:57:17 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:57:18.229065 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:18.229687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:18.236916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.237371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.238265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.238711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.480970 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:18.491079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4c9ae55b-27aa-42fe-9137-6d09c1f7c4ee tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1267 microversion: 2.1 time: 0.265538 May 13 13:57:18.501296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 432/870] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:18 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:18.954765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-a23666ab-3bb7-40fb-93f2-2d6858871de4 req-a1913cf1-b745-48fa-a656-a9244cd5ac8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:18.963357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a23666ab-3bb7-40fb-93f2-2d6858871de4 req-a1913cf1-b745-48fa-a656-a9244cd5ac8b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.963801 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a23666ab-3bb7-40fb-93f2-2d6858871de4 req-a1913cf1-b745-48fa-a656-a9244cd5ac8b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.975235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-a23666ab-3bb7-40fb-93f2-2d6858871de4 req-a1913cf1-b745-48fa-a656-a9244cd5ac8b service nova] Creating event network-changed:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 13:57:18.980319 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-a23666ab-3bb7-40fb-93f2-2d6858871de4 req-a1913cf1-b745-48fa-a656-a9244cd5ac8b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029755 May 13 13:57:18.980910 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 439/871] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:19.508996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:19.510430 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:19.520917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.521386 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.522224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.522666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.980018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:19.988080 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ec4b2c45-d020-4a67-abf2-50c27833fd8a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1453 microversion: 2.1 time: 0.482907 May 13 13:57:19.988880 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 433/872] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:19 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1453 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:20.005415 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:20.006134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:20.013050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.013722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.014531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.014962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.166856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:20.174889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eb80ab6a-f875-41ed-9d9c-a0bb4567b634 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1453 microversion: 2.1 time: 0.173857 May 13 13:57:20.187049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 440/873] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:19 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:22.012220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-4aca2fc8-a2f7-49f9-b657-334519393b24 req-bc33c4e9-9510-48c1-80b3-50a63aa2561b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f0ae3e-2ace-4327-bc72-93aaf6885296", "tag": "a33ac3fe-cf89-428e-8740-85843d8438ac"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:22.020803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4aca2fc8-a2f7-49f9-b657-334519393b24 req-bc33c4e9-9510-48c1-80b3-50a63aa2561b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:22.021316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-4aca2fc8-a2f7-49f9-b657-334519393b24 req-bc33c4e9-9510-48c1-80b3-50a63aa2561b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:22.035126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-4aca2fc8-a2f7-49f9-b657-334519393b24 req-bc33c4e9-9510-48c1-80b3-50a63aa2561b service nova] Creating event network-changed:a33ac3fe-cf89-428e-8740-85843d8438ac for instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 on hv-cinder-79578 May 13 13:57:22.040093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-4aca2fc8-a2f7-49f9-b657-334519393b24 req-bc33c4e9-9510-48c1-80b3-50a63aa2561b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031852 May 13 13:57:22.040700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 434/874] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:23.558107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:23.559552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:23.566419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.566861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.567620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.568081 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.591166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lazy-loading 'flavor' on Instance uuid 9f8823cc-14a9-477a-b4bc-0e67d4c6925c {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:23.711148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3528af4c-4fa8-4256-8fc6-be1634614229 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "POST /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c/action" status: 202 len: 0 microversion: 2.1 time: 0.159155 May 13 13:57:23.711737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 441/875] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:57:23 2022] POST /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:57:23.721581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:23.722325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:23.728753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.729212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.729994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.730475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.866901 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:23.874562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6ed7c275-df28-486e-9018-53795c9c5ed2 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.157883 May 13 13:57:23.875129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 435/876] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:23 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:24.893371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:24.894378 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:24.900934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.901380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.902190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.902626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:25.050389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:25.058513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-521024a6-1c6d-4131-9890-b970128870c9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.169933 May 13 13:57:25.059088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 442/877] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:24 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:26.079281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:26.079890 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:26.089673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.090292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.091545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.092059 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.233077 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:26.241310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0ab03f68-bc3f-454d-acec-ef29e7f769ae tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.168639 May 13 13:57:26.241875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 436/878] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:26 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:27.260569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:27.261211 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:27.271039 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.271485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.272635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.273267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.417157 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:27.429426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6df5b55a-3cbb-430a-806b-8c1b14b2b427 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.173841 May 13 13:57:27.430389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 443/879] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:27 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:28.451795 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:28.452442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:28.459674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.460151 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:28.460965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.461432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:28.599730 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:28.610209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-aa7fed0f-6521-45ce-ad33-c5b19b660682 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.165345 May 13 13:57:28.610750 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 437/880] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:28 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:29.631479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:29.632388 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:29.643720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:29.644438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:29.645708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:29.646499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:29.794640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:29.803189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f15482b2-609e-4b42-9c57-e96b0d22870c tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.178189 May 13 13:57:29.803751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 444/881] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:29 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:30.824640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:30.825653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:30.836406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.837160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.838498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.839232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.978270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:30.986026 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5eecf490-d973-4a9a-963f-60cd1b9edecb tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.167829 May 13 13:57:30.986624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 438/882] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:30 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:32.008267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:32.009149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:32.017891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.018379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.019146 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.019577 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.172868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:32.183011 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-67424ff4-a003-404a-8e52-bd3a74410c22 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.181137 May 13 13:57:32.183817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 445/883] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:31 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:33.205274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:33.206063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:33.213989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.214646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.215560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.216078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.363472 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:33.373631 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f7f288e6-9004-44d7-acff-d677aa2d263f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.174268 May 13 13:57:33.375352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 439/884] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:33 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:33.600679 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:33.601193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:33.607948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.608510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.609528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.609973 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.690903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lazy-loading 'services' on Instance uuid 5f63ab4b-27a8-43ab-80d0-85f8088e5523 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:33.767976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-62341805-52a5-4c3b-91de-9bcdf8bb92d4 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments/2d5c80c4-9256-4795-882c-ab954c977702" status: 202 len: 0 microversion: 2.1 time: 0.171170 May 13 13:57:33.768616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 446/885] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 13:57:33 2022] DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments/2d5c80c4-9256-4795-882c-ab954c977702 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:57:33.777249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:33.778274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:33.784688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.785176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.785920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.786384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.823029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3470dca1-91c4-4e45-ab41-de217b5e5f86 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049707 May 13 13:57:33.823480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 440/886] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 13:57:33 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:34.401861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.403040 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:34.411659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.412108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.412870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.413307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.555429 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:34.563073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-03f5db5b-0d7f-479a-967e-070fe8dec05b tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.168388 May 13 13:57:34.563864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 447/887] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:34.835019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.835957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:34.842536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.843018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.844670 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.845209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.881518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-24672a96-52d6-462a-bfb6-08c72d9aae70 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050452 May 13 13:57:34.882116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 441/888] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:35.585282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.586437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:35.598016 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.598826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:35.600103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.600828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:35.741428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:35.749464 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-81b02f21-8e95-40d7-ba0e-10bad16edd78 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.171633 May 13 13:57:35.750025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 448/889] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:35.897725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.899149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:35.908760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.909208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:35.909976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.910445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.103074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4690d480-a4d3-402f-bc43-d3081336f524 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.212012 May 13 13:57:36.103671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 442/890] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:57:36.179006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:36.179493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:36.185613 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.186105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.186933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.187364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.211892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:36.292476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-04615934-4dd5-49ba-a51d-582c17374353 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 204 len: 0 microversion: 2.1 time: 0.117152 May 13 13:57:36.293105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 449/891] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:57:36 2022] DELETE /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:36.301390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:36.301996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:36.308195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.308644 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.309403 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.309836 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.446465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:36.454646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b7eeb207-9662-417f-9e58-c5e7f555e01f tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1687 microversion: 2.1 time: 0.157156 May 13 13:57:36.455213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 443/892] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:36 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:36.772767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:36.773468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:36.780157 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.781029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.781791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.782270 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.934028 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:36.945134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9e939961-3063-40cd-a8f3-3fc06cd06bd9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.176553 May 13 13:57:36.945896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 450/893] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:36 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:37.476581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:37.477558 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:37.489443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.490265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.491552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.492289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.634846 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:37.643288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4fada9f4-5e4f-4413-8717-eef036432d03 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1687 microversion: 2.1 time: 0.173384 May 13 13:57:37.643825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 444/894] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:37 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:37.969328 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:37.970349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:37.981278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.982021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.983315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.984076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.131763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:38.139750 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bf770acb-f146-483c-97c4-ed04843a700d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.177525 May 13 13:57:38.140925 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 451/895] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:37 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:38.662912 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:38.663660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:38.672131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.672681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.673673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.674099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.809033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:38.817206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-02f6fd84-d333-46a4-91ea-690a51df3064 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1687 microversion: 2.1 time: 0.159397 May 13 13:57:38.817769 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 445/896] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:38 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:39.163391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:39.164558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:39.174492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.174941 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.175702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.176138 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.323109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:39.332701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a50e20e8-3803-4f49-939d-1eb75b3858ee tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.177240 May 13 13:57:39.333279 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 452/897] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:39 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:39.837063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:39.838433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:39.848866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.849574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.850866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.851546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.990316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:40.002871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0c6adecd-cade-4c32-9945-ce0d84353bb9 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1687 microversion: 2.1 time: 0.170251 May 13 13:57:40.003539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 446/898] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:39 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:40.353017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:40.353712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:40.362778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.363361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.364646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.365614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.513746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:40.522353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-45132e36-d88e-4cd8-a357-77e80266633e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.175175 May 13 13:57:40.522933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 453/899] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:40 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:41.025073 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.026021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.033245 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.033717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.034763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.035443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.272121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.280310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7a8307a7-22ed-4339-8614-e6cd51838347 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1687 microversion: 2.1 time: 0.259254 May 13 13:57:41.281584 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 447/900] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1687 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:41.466837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.468090 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.475190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.475738 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.476824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.477333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.508946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-884b08e6-d489-41b5-a96b-da1459fd6631 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046786 May 13 13:57:41.509735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 454/901] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:57:41.541449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.542255 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.551760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.552580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.553708 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.554675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.582893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.583506 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.590095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.590548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.591365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.591991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.619467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:41.707292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-38de1b09-d4b3-445b-8aa0-b3fee14c4dbe tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 204 len: 0 microversion: 2.1 time: 0.128192 May 13 13:57:41.708341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 455/902] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:57:41 2022] DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:41.719159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.719824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.726101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.726559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.727927 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.728402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.843835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.852224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fb2b0cf2-3b6f-4146-8a32-215a810dae64 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1506 microversion: 2.1 time: 0.315750 May 13 13:57:41.854593 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 448/903] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:41.869412 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:41.870104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.875851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.876589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.877140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.878437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.878858 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.884421 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a794f9de-bc51-4f8e-98a6-a3d84a5b8827 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1672 microversion: 2.1 time: 0.170982 May 13 13:57:41.885221 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 456/904] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:41.982554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8b7f6590-683b-434c-9397-7f239a0f0208 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "POST /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c/action" status: 202 len: 0 microversion: 2.1 time: 0.116895 May 13 13:57:41.986424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 449/905] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 13:57:41 2022] POST /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:57:42.003502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.004119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.010804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.011255 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.012033 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.012464 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.154244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:42.162327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-71a0eb80-9b94-4519-8bb0-47f7bcd85ff1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1514 microversion: 2.1 time: 0.162984 May 13 13:57:42.162907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 457/906] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:42.303695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.304305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.311601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.312146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.313101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.313784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.409525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:42.417469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-72e12399-cb66-453b-8e99-f5f4900bdfe8 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1620 microversion: 2.1 time: 0.122893 May 13 13:57:42.421007 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-8bf1b3b1-e05b-48b5-bfe1-33707446635c req-4337b30c-9117-4d0e-8e30-ffb06863ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f63ab4b-27a8-43ab-80d0-85f8088e5523", "name": "network-vif-deleted", "tag": "53caaaa2-8ac5-4f0e-99ed-f354f067cd35"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:42.421969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 450/907] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:42 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1620 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:42.435430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8bf1b3b1-e05b-48b5-bfe1-33707446635c req-4337b30c-9117-4d0e-8e30-ffb06863ff8e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.436195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8bf1b3b1-e05b-48b5-bfe1-33707446635c req-4337b30c-9117-4d0e-8e30-ffb06863ff8e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.452521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-8bf1b3b1-e05b-48b5-bfe1-33707446635c req-4337b30c-9117-4d0e-8e30-ffb06863ff8e service nova] Creating event network-vif-deleted:53caaaa2-8ac5-4f0e-99ed-f354f067cd35 for instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 on hv-cinder-79578 May 13 13:57:42.462021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-8bf1b3b1-e05b-48b5-bfe1-33707446635c req-4337b30c-9117-4d0e-8e30-ffb06863ff8e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044519 May 13 13:57:42.464036 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 458/908] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:42.699504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-59df86be-3d1d-4738-b18f-6c88fe3a5144 req-cf794b35-f908-4079-95f8-da79360856ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "name": "network-vif-unplugged", "status": "completed", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:42.712147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-59df86be-3d1d-4738-b18f-6c88fe3a5144 req-cf794b35-f908-4079-95f8-da79360856ec service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.712596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-59df86be-3d1d-4738-b18f-6c88fe3a5144 req-cf794b35-f908-4079-95f8-da79360856ec service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.732330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.compute.server_external_events [req-59df86be-3d1d-4738-b18f-6c88fe3a5144 req-cf794b35-f908-4079-95f8-da79360856ec service nova] Unable to find a host for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c. Dropping event network-vif-unplugged {{(pid=123954) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 13:57:42.733224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-59df86be-3d1d-4738-b18f-6c88fe3a5144 req-cf794b35-f908-4079-95f8-da79360856ec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037637 May 13 13:57:42.734030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 451/909] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 13 13:57:42.903889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.904593 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.913064 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.913522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.914326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.914774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.049331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.058205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1f91694e-4e00-45b6-bab8-75992cd6627a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1672 microversion: 2.1 time: 0.157597 May 13 13:57:43.059298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 459/910] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:42 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:43.179224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:43.179988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:43.186232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.186679 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.187512 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.187946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.328317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.336854 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-65b7acad-5f46-48d6-8196-a35ee3b6dead tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1514 microversion: 2.1 time: 0.161483 May 13 13:57:43.347482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 452/911] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:43 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:43.436346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:43.438035 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:43.445724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.447053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.448207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.448940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.489047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.489739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.491358 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lazy-loading 'fault' on Instance uuid 5f63ab4b-27a8-43ab-80d0-85f8088e5523 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:43.536903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.545741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-692050b2-c9f9-4578-9be3-1614ceb192eb tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 200 len: 1334 microversion: 2.1 time: 0.114248 May 13 13:57:43.546874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 460/912] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:43 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 1334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.080267 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.080963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.089875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.090698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.093641 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.095072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.194622 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:44.202634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c64e0a57-b95c-4b8f-b48a-e89947fa016e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 200 len: 1605 microversion: 2.1 time: 0.129460 May 13 13:57:44.210187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 453/913] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 1605 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.354708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.355337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.377913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.382614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.383598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.384045 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.477839 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-93ab28a6-bb60-4e0b-9798-89edb0d08bbf req-66ff9e86-d53e-4d82-a924-0539ba6fb1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fef620-abd7-40d5-a072-6af7a0a22ad0", "name": "network-vif-deleted", "tag": "bb69988a-2d0c-4a82-9daa-b671976e609d"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:44.494917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-93ab28a6-bb60-4e0b-9798-89edb0d08bbf req-66ff9e86-d53e-4d82-a924-0539ba6fb1cf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.495633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-93ab28a6-bb60-4e0b-9798-89edb0d08bbf req-66ff9e86-d53e-4d82-a924-0539ba6fb1cf service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.508879 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-93ab28a6-bb60-4e0b-9798-89edb0d08bbf req-66ff9e86-d53e-4d82-a924-0539ba6fb1cf service nova] Creating event network-vif-deleted:bb69988a-2d0c-4a82-9daa-b671976e609d for instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 on hv-cinder-79578 May 13 13:57:44.515253 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-93ab28a6-bb60-4e0b-9798-89edb0d08bbf req-66ff9e86-d53e-4d82-a924-0539ba6fb1cf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041615 May 13 13:57:44.516618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 454/914] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:44.539227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:44.547930 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-246d848a-8da2-4460-942b-7f731c2e051a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.197227 May 13 13:57:44.548876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 461/915] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.563737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.564546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 5f63ab4b-27a8-43ab-80d0-85f8088e5523] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.571608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.572371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.573402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.573845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.588286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] HTTP exception thrown: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Request method failure captured: May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 HTTP/1.1 May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHmoYcXdpLJ0mvorCl5JvtXnQvdvSc0qcaI5DOYf55NIuNJ8Oy6IGOmr5HmQO94HqnEmCd2US9nN2h0c5MKlvfDiCH7Ht1lFA30TWE7YckEcEgOiEI_xGSE6LctKDV1baE2Ay0dNvSQfiWeikOMp886N_OE-nsmDBQWBo_Z1Bv_raQ May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:44.590060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f9ca490113764eba85daa6ca9fbba5f5 May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. May 13 13:57:44.592004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '5f63ab4b-27a8-43ab-80d0-85f8088e5523'} May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:44.593274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. May 13 13:57:44.595691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:44.597392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Returning 404 to user: Instance 5f63ab4b-27a8-43ab-80d0-85f8088e5523 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:44.597392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3c0aa585-7976-4a16-b2e5-583b0e73c71c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523" status: 404 len: 111 microversion: 2.1 time: 0.032204 May 13 13:57:44.597392 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 455/916] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/5f63ab4b-27a8-43ab-80d0-85f8088e5523 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:57:44.603380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3ff90d92-2090-4480-a693-5a56681a314c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '.version_select at 0x7ff1590a51f0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.621795 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3ff90d92-2090-4480-a693-5a56681a314c tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906725682" status: 202 len: 0 microversion: 2.1 time: 0.023046 May 13 13:57:44.622601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 462/917] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 13:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906725682 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:57:45.220536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.221148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:45.228004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.228691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.229650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.230313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.247990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 HTTP/1.1 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:45.249548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 13:57:45.251093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '26fef620-abd7-40d5-a072-6af7a0a22ad0'} May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:45.251886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 13:57:45.253110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:45.254222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:45.254222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bc361c11-d65f-4a57-9e36-ae3f57aa137b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 404 len: 111 microversion: 2.1 time: 0.034473 May 13 13:57:45.254222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 456/918] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:45 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:45.260103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2118728c-f768-4a50-b74e-34e50683ec37 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '.version_select at 0x7ff1590af9d0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.280265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2118728c-f768-4a50-b74e-34e50683ec37 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006578398" status: 202 len: 0 microversion: 2.1 time: 0.023991 May 13 13:57:45.281778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 463/919] 10.222.0.24 () {58 vars in 1220 bytes} [Fri May 13 13:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006578398 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:57:45.567659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.569068 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:45.577247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.577983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.579278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.580853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:46.156975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:46.165171 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a5809d64-8523-4a2e-8b90-8707162c9c20 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.603496 May 13 13:57:46.165748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 457/920] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:45 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:46.499757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4703bd7c-2e8e-49c5-a65f-ab41e87455ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: .version_select at 0x7ff1590895e0>, body: {"keypair": {"name": "tempest-keypair-322917260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFvUMFIESG1sueL6M+0YKMBF5IVnZudjt6bEUAeUyNMp6oXi/X2IMlHH1LaCoS2rUgLywoISFVDVNJSW3PYAxL1tbHjzcUofvgZLoBF7F1vn39p1Zl7H33DFTVAdQCZnQ=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:46.516515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-4703bd7c-2e8e-49c5-a65f-ab41e87455ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for project b55a828bec5e46079d85da062846e17e. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:46.520995 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-4703bd7c-2e8e-49c5-a65f-ab41e87455ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for user f789eaddc18244e0a1f8246e6eb21991 and project b55a828bec5e46079d85da062846e17e. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:46.547165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4703bd7c-2e8e-49c5-a65f-ab41e87455ba tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051499 May 13 13:57:46.547971 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 464/921] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:57:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:47.182682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.183279 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.190634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.191213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.192542 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.192994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.325654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:47.335502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1fc7d8c5-f767-4bec-a147-96078ed59bb7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.156592 May 13 13:57:47.336340 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 458/922] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:47 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:47.759604 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.760154 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.766378 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.766884 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.767727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.768220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.794058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:47.861360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-858349447", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8904d1e8-57c1-4669-957b-1076c1fb91b9"}], "security_groups": [{"name": "tempest-securitygroup--38676920"}], "key_name": "tempest-keypair-322917260", "user_data": "}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:47.876958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e0eafdfa-af5f-467a-a82e-74cc39825ef1 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 204 len: 0 microversion: 2.1 time: 0.121547 May 13 13:57:47.877809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 465/923] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:57:47 2022] DELETE /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:47.887546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.888395 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.896434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.896885 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.897672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.898139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.974238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] validate_networks() for [('8904d1e8-57c1-4669-957b-1076c1fb91b9', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:57:48.028087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:48.036027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-feace4f5-1f6c-44df-9ea2-c131ff8fc288 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1508 microversion: 2.1 time: 0.153543 May 13 13:57:48.036612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 466/924] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:47 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:48.352811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:48.353419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:48.359426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.360002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.361242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.361678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.362427 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:57:48.362886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:57:48.363304 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:57:48.363705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:57:48.364109 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:57:48.372968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.373419 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.374259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.374680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.390945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for project b55a828bec5e46079d85da062846e17e. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:48.394962 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Getting quotas for user f789eaddc18244e0a1f8246e6eb21991 and project b55a828bec5e46079d85da062846e17e. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:48.406246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:57:48.408755 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:57:48.456650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1673e29b-9947-4c07-b3f6-a381c0c037af tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.599648 May 13 13:57:48.460583 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 459/925] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:57:47 2022] POST /compute/v2.1/servers => generated 400 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:57:48.469341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-780647d0-bdb8-46b7-bc5b-ef9509873f51 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:48.470029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-780647d0-bdb8-46b7-bc5b-ef9509873f51 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:48.511115 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:48.519418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4544f7d4-66ff-4e7f-9034-0e6ad5ae8945 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.170474 May 13 13:57:48.520073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 467/926] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:48 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:48.526764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-780647d0-bdb8-46b7-bc5b-ef9509873f51 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:48.534453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-780647d0-bdb8-46b7-bc5b-ef9509873f51 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1236 microversion: 2.1 time: 0.068959 May 13 13:57:48.535101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 460/927] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:48 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:49.053329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:49.053885 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:49.060140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.060846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.061790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.062251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.198059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.205798 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7e873657-28f8-47d8-bdb4-52b0230a2ef7 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 200 len: 1508 microversion: 2.1 time: 0.156790 May 13 13:57:49.206404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 468/928] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:49 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:49.327491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-f4fe21a7-5e44-4934-a111-ebd65b2bd86e req-dbc8ca7f-2157-425f-9de4-6fcdd6c44bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa256c0-8e95-448c-8c8b-f639d17d1ade", "name": "network-vif-deleted", "tag": "edb51ec7-82e4-4dfb-b862-eb58ed42115b"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:49.336891 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-f4fe21a7-5e44-4934-a111-ebd65b2bd86e req-dbc8ca7f-2157-425f-9de4-6fcdd6c44bf4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.337321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-f4fe21a7-5e44-4934-a111-ebd65b2bd86e req-dbc8ca7f-2157-425f-9de4-6fcdd6c44bf4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.349018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-f4fe21a7-5e44-4934-a111-ebd65b2bd86e req-dbc8ca7f-2157-425f-9de4-6fcdd6c44bf4 service nova] Creating event network-vif-deleted:edb51ec7-82e4-4dfb-b862-eb58ed42115b for instance efa256c0-8e95-448c-8c8b-f639d17d1ade on hv-cinder-79578 May 13 13:57:49.354112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-f4fe21a7-5e44-4934-a111-ebd65b2bd86e req-dbc8ca7f-2157-425f-9de4-6fcdd6c44bf4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 May 13 13:57:49.354690 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 461/929] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:49.541398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:49.542468 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:49.550436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.551283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.552580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:49.553060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.553060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.553995 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:49.561599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.562305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.563234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.563875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.649664 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.667079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f91c48f2-6a0f-442f-816b-24746694c78c tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1296 microversion: 2.1 time: 0.118851 May 13 13:57:49.667749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 462/930] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:49 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:49.732609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.740899 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6aa31c38-9792-4d1c-b2dd-cd157acc60f7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.207013 May 13 13:57:49.741471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 469/931] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:49 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:50.223110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.223728 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: efa256c0-8e95-448c-8c8b-f639d17d1ade] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.230066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.230533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.231306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.231749 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.245516 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] HTTP exception thrown: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Request method failure captured: May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade HTTP/1.1 May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHmoYcXdpLJ0mvorCl5JvtXnQvdvSc0qcaI5DOYf55NIuNJ8Oy6IGOmr5HmQO94HqnEmCd2US9nN2h0c5MKlvfDiCH7Ht1lFA30TWE7YckEcEgOiEI_xGSE6LctKDV1baE2Ay0dNvSQfiWeikOMp886N_OE-nsmDBQWBo_Z1Bv_raQ May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:50.247686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f9ca490113764eba85daa6ca9fbba5f5 May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. May 13 13:57:50.249240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'efa256c0-8e95-448c-8c8b-f639d17d1ade'} May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:50.250152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. May 13 13:57:50.251602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:50.252916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Returning 404 to user: Instance efa256c0-8e95-448c-8c8b-f639d17d1ade could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:50.252916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-14743cbd-1650-48aa-ae16-6b088f96b914 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade" status: 404 len: 111 microversion: 2.1 time: 0.030768 May 13 13:57:50.252916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 463/932] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/efa256c0-8e95-448c-8c8b-f639d17d1ade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:50.258584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.259149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.265426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.265874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.266751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.267241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.292790 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:50.383572 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a67cebc-d04f-4dcc-906a-710ef55123ae tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "DELETE /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 204 len: 0 microversion: 2.1 time: 0.128793 May 13 13:57:50.384451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 470/933] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:57:50 2022] DELETE /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:57:50.392833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.393867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.400196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.400652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.401431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.401875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.589498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.597230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1cae46c6-89ad-4fab-afaa-c3efcc5b6819 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.208419 May 13 13:57:50.597798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 464/934] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:50.685409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.686235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.699422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.699879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.700721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.701377 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.758149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.758957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.765266 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.765714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.766578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.767018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.846391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.854102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a1076c9d-088e-4394-b086-433f32a483e6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.172869 May 13 13:57:50.854969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 471/935] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:50.980672 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.989435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5ea9a964-64d4-4467-bce6-a052ef072c31 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.235286 May 13 13:57:50.990030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 465/936] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:51.515735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-d3392505-c582-48f4-9c14-ae9a94ea7e66 req-3540dd5e-ffdc-4eb6-9c13-e9ac5d4cc9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270b4062-876f-4f9b-a400-f9f7d9563aac", "tag": "63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:51.529558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d3392505-c582-48f4-9c14-ae9a94ea7e66 req-3540dd5e-ffdc-4eb6-9c13-e9ac5d4cc9c4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.530453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d3392505-c582-48f4-9c14-ae9a94ea7e66 req-3540dd5e-ffdc-4eb6-9c13-e9ac5d4cc9c4 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.552499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-d3392505-c582-48f4-9c14-ae9a94ea7e66 req-3540dd5e-ffdc-4eb6-9c13-e9ac5d4cc9c4 service nova] Creating event network-changed:63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0 for instance 270b4062-876f-4f9b-a400-f9f7d9563aac on hv-cinder-79578 May 13 13:57:51.558020 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-d3392505-c582-48f4-9c14-ae9a94ea7e66 req-3540dd5e-ffdc-4eb6-9c13-e9ac5d4cc9c4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048501 May 13 13:57:51.559364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 472/937] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:51.615828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:51.617083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:51.624041 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.624787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.625918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.627260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.867810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:51.871670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:51.872581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:51.876456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5210574c-f4f8-4c92-aa50-0850810d40d6 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1523 microversion: 2.1 time: 0.264326 May 13 13:57:51.877583 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 466/938] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:51 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:51.879397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.879995 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.880931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.881498 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.008099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:52.008952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:52.018103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.018981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.020414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.021146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.072618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.081035 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ee8d2c8c-a0fb-49db-890c-a3cb19db17dc tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.213330 May 13 13:57:52.081714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 473/939] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:51 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:52.175405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.184243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-06c6ab8e-74ce-41c5-a267-b397e478d9e0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.180731 May 13 13:57:52.184454 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-5ac1fbb4-56cd-47b1-bd29-d5e711f71cf9 req-f6aa20dd-18ce-4879-99dd-141512f4c1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361ca01b-bda3-4060-a318-72a052700b32", "name": "network-vif-deleted", "tag": "0c30fb69-0384-45e4-b5b2-d0ee5152cea8"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:52.193235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-5ac1fbb4-56cd-47b1-bd29-d5e711f71cf9 req-f6aa20dd-18ce-4879-99dd-141512f4c1fa service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.193958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-5ac1fbb4-56cd-47b1-bd29-d5e711f71cf9 req-f6aa20dd-18ce-4879-99dd-141512f4c1fa service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.195120 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 467/940] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:52 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:52.205559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-5ac1fbb4-56cd-47b1-bd29-d5e711f71cf9 req-f6aa20dd-18ce-4879-99dd-141512f4c1fa service nova] Creating event network-vif-deleted:0c30fb69-0384-45e4-b5b2-d0ee5152cea8 for instance 361ca01b-bda3-4060-a318-72a052700b32 on hv-cinder-79578 May 13 13:57:52.210617 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-5ac1fbb4-56cd-47b1-bd29-d5e711f71cf9 req-f6aa20dd-18ce-4879-99dd-141512f4c1fa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029907 May 13 13:57:52.211206 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 474/941] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:52.897314 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:52.898373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:52.909864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.910640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.911914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.912683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.980273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.992030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-abd48c00-ffc4-4c40-b52e-6bdd2e9b18cc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1481 microversion: 2.1 time: 0.101193 May 13 13:57:52.992781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 468/942] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:52 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1481 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:53.105965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:53.107156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:53.119390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.120240 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.121519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.122314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.202533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:53.203276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:53.209518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.210063 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.210861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.211307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.270375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:53.278010 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ec09d47b-7a07-45a2-a49a-b3bcd96187fd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.180268 May 13 13:57:53.278794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 475/943] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:53 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:53.352324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:53.360677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-080ecbb6-2826-47aa-8f7d-cafae61fe728 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.161752 May 13 13:57:53.361619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 469/944] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:53 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:54.019635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.020541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.031258 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.031988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.033268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.033721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.104519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:54.113444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-790b8252-8d4c-40d7-8f3e-f8be646d1360 tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1481 microversion: 2.1 time: 0.103342 May 13 13:57:54.114063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 476/945] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1481 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:54.299681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.300326 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.308565 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.309119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.310083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.310649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.378078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.378732 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.385172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.385626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.386433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.386873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.449135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:54.457272 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0b42391a-961c-4bb1-84e8-5f45cd0299d3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.163974 May 13 13:57:54.457843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 470/946] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:54.521947 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:54.529682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1992ea7d-1164-437a-97f1-5d907e17c1e5 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.155501 May 13 13:57:54.530331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 477/947] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:55.130784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:55.131401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:55.137955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.138439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.139203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.139633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.213071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:55.221376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b7e3f188-2999-4822-a5fa-3a82ef407efa tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1307 microversion: 2.1 time: 0.094555 May 13 13:57:55.221944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 471/948] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:55 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:55.478330 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:55.478980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:55.488347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.488873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.489640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.490088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.547801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:55.548434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:55.555306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.555765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.556543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.556983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.629465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:55.637360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-49c9d40f-aba0-49df-ba76-53688d7a1ed8 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.165198 May 13 13:57:55.637906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 478/949] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:55 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:55.688446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:55.699507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e9c14115-57d2-417b-ae15-04dbb7d0cd76 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.155413 May 13 13:57:55.700258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 472/950] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:55 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:56.247537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:56.248538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:56.256736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.257179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.257935 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.258402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.330487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ca490113764eba85daa6ca9fbba5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2095d695f3ca4a9db0ab383b1f8f13ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.338447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f8b31ab9-0332-4b0a-b0d9-f8623407e3bc tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 200 len: 1307 microversion: 2.1 time: 0.097336 May 13 13:57:56.339005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 479/951] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:56 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:56.655580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:56.656556 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:56.664319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.664861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.666221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.666616 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.718267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:56.719024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:56.729292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.732073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.733065 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.733595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.841215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.851247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-714d1492-f689-4b80-b6af-1e844efb454b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.200225 May 13 13:57:56.851906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 473/952] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:56 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:56.953520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.961977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2c4cbe84-a3da-4b49-b900-17f15118c7d0 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.247633 May 13 13:57:56.962594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 480/953] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:56 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:57.359974 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.360907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] [instance: 361ca01b-bda3-4060-a318-72a052700b32] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.367344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.367794 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.368545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.368986 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.382713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] HTTP exception thrown: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Request method failure captured: May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 HTTP/1.1 May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHmoYcXdpLJ0mvorCl5JvtXnQvdvSc0qcaI5DOYf55NIuNJ8Oy6IGOmr5HmQO94HqnEmCd2US9nN2h0c5MKlvfDiCH7Ht1lFA30TWE7YckEcEgOiEI_xGSE6LctKDV1baE2Ay0dNvSQfiWeikOMp886N_OE-nsmDBQWBo_Z1Bv_raQ May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 13:57:57.384247 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2095d695f3ca4a9db0ab383b1f8f13ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 2095d695f3ca4a9db0ab383b1f8f13ec May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1207217990 May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f9ca490113764eba85daa6ca9fbba5f5 May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1207217990-project May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. May 13 13:57:57.385721 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '361ca01b-bda3-4060-a318-72a052700b32'} May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:57.386573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. May 13 13:57:57.387919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 13:57:57.389212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] Returning 404 to user: Instance 361ca01b-bda3-4060-a318-72a052700b32 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:57.389212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-644ffedd-2bd0-4763-97aa-5587e3dba11a tempest-ServerRescueNegativeTestJSON-1207217990 tempest-ServerRescueNegativeTestJSON-1207217990-project] 10.222.0.24 "GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32" status: 404 len: 111 microversion: 2.1 time: 0.032324 May 13 13:57:57.389212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 474/954] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/361ca01b-bda3-4060-a318-72a052700b32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:57.868686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.869509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.876361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.877336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.877640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.878074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.978065 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.979621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.986606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.987551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.988588 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.989195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.014934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:58.023182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a87c7d9f-443a-462b-a4fc-bd9024df8b5e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.158430 May 13 13:57:58.023760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 481/955] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:58.257474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:58.265375 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b1bad238-b3a1-40df-b14c-8df60c6a4b74 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.291179 May 13 13:57:58.265866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 475/956] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:58.785831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-25b51cbc-837d-41fc-933a-2d32704c6bb3 req-175a3a01-8fb0-4274-82cc-8dea3e114fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270b4062-876f-4f9b-a400-f9f7d9563aac", "name": "network-vif-plugged", "status": "completed", "tag": "63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:58.794755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-25b51cbc-837d-41fc-933a-2d32704c6bb3 req-175a3a01-8fb0-4274-82cc-8dea3e114fa9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:58.795376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-25b51cbc-837d-41fc-933a-2d32704c6bb3 req-175a3a01-8fb0-4274-82cc-8dea3e114fa9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.810321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-25b51cbc-837d-41fc-933a-2d32704c6bb3 req-175a3a01-8fb0-4274-82cc-8dea3e114fa9 service nova] Creating event network-vif-plugged:63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0 for instance 270b4062-876f-4f9b-a400-f9f7d9563aac on hv-cinder-79578 May 13 13:57:58.815962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-25b51cbc-837d-41fc-933a-2d32704c6bb3 req-175a3a01-8fb0-4274-82cc-8dea3e114fa9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034677 May 13 13:57:58.817853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 482/957] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:59.040944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:59.041609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:59.049126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.049604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.050611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.051060 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.284584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:59.285416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:59.294071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.294552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.295386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.295826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.297315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:59.307590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7ea34301-9a8b-4956-8c53-ec1531aa7173 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.270424 May 13 13:57:59.308325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 476/958] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:59 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:59.436579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:59.445081 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f8abfbf6-692a-48eb-9363-fd5373c9d513 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.165326 May 13 13:57:59.446235 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 483/959] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:57:59 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:00.325456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:00.326085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:00.333119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.333572 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.334380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.334821 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.468858 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:00.469449 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:00.473723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:00.477776 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.478325 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.479341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.479965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.481896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d792a08a-e055-492d-b1cf-028d56ac8713 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1360 microversion: 2.1 time: 0.160639 May 13 13:58:00.482506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 477/960] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:00 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:00.727836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:00.743698 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c053b35d-8460-47f7-8d6d-a220b7ba050d tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.284641 May 13 13:58:00.744387 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 484/961] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:00 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:00.841300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-9ddc395d-f71b-4a29-947b-dbd38f338a8c req-2d78c8cf-28a7-45ff-8e72-2e62ca813b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "name": "network-vif-plugged", "status": "completed", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:00.849914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-9ddc395d-f71b-4a29-947b-dbd38f338a8c req-2d78c8cf-28a7-45ff-8e72-2e62ca813b99 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.850394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-9ddc395d-f71b-4a29-947b-dbd38f338a8c req-2d78c8cf-28a7-45ff-8e72-2e62ca813b99 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.861762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-9ddc395d-f71b-4a29-947b-dbd38f338a8c req-2d78c8cf-28a7-45ff-8e72-2e62ca813b99 service nova] Creating event network-vif-plugged:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 13:58:00.867422 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-9ddc395d-f71b-4a29-947b-dbd38f338a8c req-2d78c8cf-28a7-45ff-8e72-2e62ca813b99 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029840 May 13 13:58:00.868532 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 478/962] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:58:01.498503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:01.499159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:01.506086 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.506528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.507295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.507979 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.641855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:01.649499 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-82bb8cb1-a7a5-4799-8524-6b666b066239 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1546 microversion: 2.1 time: 0.154906 May 13 13:58:01.650106 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 485/963] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:01 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:01.669464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:01.670356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:01.676599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.677049 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.677816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.678280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.757802 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5d85ad9b-f398-4b5a-9adb-35b148f6d54b tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093301 May 13 13:58:01.763941 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 479/964] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 13:58:01 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:01.764130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:01.764130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:01.767886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.768369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.769159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.769799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.911508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:01.919407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-37ed3f33-5e04-4330-bb45-0da9509ab6d7 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.162279 May 13 13:58:01.922092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 486/965] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:01 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:02.762913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-cdce8c01-b7b2-44d1-8185-77355e63e96d req-849321a0-1f09-4db0-8372-680eb7f69b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270b4062-876f-4f9b-a400-f9f7d9563aac", "tag": "63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:02.771783 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-cdce8c01-b7b2-44d1-8185-77355e63e96d req-849321a0-1f09-4db0-8372-680eb7f69b7b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:02.772216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-cdce8c01-b7b2-44d1-8185-77355e63e96d req-849321a0-1f09-4db0-8372-680eb7f69b7b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:02.788905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-cdce8c01-b7b2-44d1-8185-77355e63e96d req-849321a0-1f09-4db0-8372-680eb7f69b7b service nova] Creating event network-changed:63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0 for instance 270b4062-876f-4f9b-a400-f9f7d9563aac on hv-cinder-79578 May 13 13:58:02.793382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-cdce8c01-b7b2-44d1-8185-77355e63e96d req-849321a0-1f09-4db0-8372-680eb7f69b7b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034988 May 13 13:58:02.797462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 480/966] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:02.937261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:02.938614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:02.950396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:02.951239 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:02.953720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:02.954536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:03.163534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:03.172323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fa9cf241-c8b3-45a4-a0d4-97031926d3a8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1572 microversion: 2.1 time: 0.239305 May 13 13:58:03.181946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 487/967] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:02 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1572 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:04.190989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:04.191712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:04.198400 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.198967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.199905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.200753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.352717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:04.360372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0448012a-4459-4bec-9a2d-6e8388627f94 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1559 microversion: 2.1 time: 0.174269 May 13 13:58:04.360980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 481/968] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:04 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:07.287461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c13e86d9-3b44-4c0f-a861-8c3bc2279793 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: .version_select at 0x7ff15421daf0>, body: {"keypair": {"name": "tempest-keypair-310686398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaSD5WqIJ5N51VRinmIlp83+93bOMBKhScwoadVlq/sHVskJ5XU/gjmi+zDLSdSRGA+QKLa3zJjYFzk1og09B2IugdmtCshudL9cswhuazJVKNTuDhVnbRsr6y7DHX1/A=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:07.303701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-c13e86d9-3b44-4c0f-a861-8c3bc2279793 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:58:07.307985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-c13e86d9-3b44-4c0f-a861-8c3bc2279793 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:58:07.334217 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c13e86d9-3b44-4c0f-a861-8c3bc2279793 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187660 May 13 13:58:07.334927 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 488/969] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 13:58:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:08.643178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-372138323", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271e298e-b7ac-45a3-816f-485dc01eb596"}], "security_groups": [{"name": "tempest-securitygroup--1863398130"}], "key_name": "tempest-keypair-310686398", "user_data": "}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:08.743270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] validate_networks() for [('271e298e-b7ac-45a3-816f-485dc01eb596', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:58:09.123987 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:58:09.124406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:58:09.124905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:58:09.125307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:58:09.125711 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:58:09.134957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:09.135415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:09.136203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:09.136657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:09.153683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:58:09.160920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:58:09.175027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:58:09.176633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:58:09.232602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8698cef7-1f36-4a78-bed5-af9cf3589faf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.593797 May 13 13:58:09.234131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 482/970] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:58:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:58:09.251638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-153054da-d23a-4100-a465-b7ec9e64727e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:09.252403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-153054da-d23a-4100-a465-b7ec9e64727e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:09.334114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-153054da-d23a-4100-a465-b7ec9e64727e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:09.342019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-153054da-d23a-4100-a465-b7ec9e64727e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1240 microversion: 2.1 time: 0.101795 May 13 13:58:09.342903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 489/971] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:09 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:10.360947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:10.361977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:10.369214 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:10.369660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:10.370466 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:10.370898 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:10.441957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:10.450654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c58c7228-71fe-4eae-ae9d-be836fa8629f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1300 microversion: 2.1 time: 0.094206 May 13 13:58:10.451663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 483/972] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:10 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:11.469439 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:11.471418 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:11.480053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:11.480456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:11.481466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:11.481932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:11.687597 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:11.695831 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d5963f6b-9077-4658-9826-4a19586ab07c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.230819 May 13 13:58:11.702085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 490/973] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:11 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:12.249220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-445279e1-58a4-45ea-91db-e88f2781fc95 req-9f6ef244-37c2-4a92-9598-d44ff7ea12d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ecf924-4cfd-40a6-8d24-66b488062838", "tag": "faceb057-7205-4f60-9de5-e4f95841e5ad"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:12.260911 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-445279e1-58a4-45ea-91db-e88f2781fc95 req-9f6ef244-37c2-4a92-9598-d44ff7ea12d6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:12.261650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-445279e1-58a4-45ea-91db-e88f2781fc95 req-9f6ef244-37c2-4a92-9598-d44ff7ea12d6 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:12.275202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-445279e1-58a4-45ea-91db-e88f2781fc95 req-9f6ef244-37c2-4a92-9598-d44ff7ea12d6 service nova] Creating event network-changed:faceb057-7205-4f60-9de5-e4f95841e5ad for instance 62ecf924-4cfd-40a6-8d24-66b488062838 on hv-cinder-79578 May 13 13:58:12.280373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-445279e1-58a4-45ea-91db-e88f2781fc95 req-9f6ef244-37c2-4a92-9598-d44ff7ea12d6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 May 13 13:58:12.281115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 484/974] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:12.713031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:12.713642 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:12.721263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:12.721713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:12.722537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:12.722969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:12.875524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:12.886704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3be59704-4f04-4698-bca9-935820734ebc tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.177328 May 13 13:58:12.887400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 491/975] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:12 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:13.910141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:13.911029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:13.918518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:13.918991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:13.919803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:13.920263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:14.073666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:14.082174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fd03484b-7255-47eb-8d70-1385ed89b997 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.180014 May 13 13:58:14.082564 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 485/976] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:13 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:15.102075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:15.102946 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:15.110706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:15.111233 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:15.112135 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:15.112671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:15.250510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:15.258233 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dd67d8d9-53c2-4634-bffb-a71fc49d3a66 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.161067 May 13 13:58:15.258775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 492/977] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:15 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:16.276190 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:16.276829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:16.283914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:16.284371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:16.285223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:16.285656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:16.431666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:16.439413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-99b91403-6577-497c-93c1-d1b8b0c6d80b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.167787 May 13 13:58:16.440801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 486/978] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:16 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:17.460053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:17.460820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:17.471350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:17.471996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:17.472767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:17.473207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:17.609381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:17.617888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e3a3f0e5-969f-4be6-ba94-6d671f169fb1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.164004 May 13 13:58:17.618510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 493/979] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:17 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:18.639685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:18.640673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:18.648950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:18.649493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:18.650316 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:18.650758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:18.792193 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:18.800292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-16591064-eb73-41f4-99f7-9b27a2c64cb5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.166993 May 13 13:58:18.800868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 487/980] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:18 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:18.895886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-91f128cd-e9e0-4d20-8c5d-4c32d890651e req-4c641a6f-f1a3-4f51-8548-ec3bc5707197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ecf924-4cfd-40a6-8d24-66b488062838", "name": "network-vif-plugged", "status": "completed", "tag": "faceb057-7205-4f60-9de5-e4f95841e5ad"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:18.904720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-91f128cd-e9e0-4d20-8c5d-4c32d890651e req-4c641a6f-f1a3-4f51-8548-ec3bc5707197 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:18.905202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-91f128cd-e9e0-4d20-8c5d-4c32d890651e req-4c641a6f-f1a3-4f51-8548-ec3bc5707197 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:18.916765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-91f128cd-e9e0-4d20-8c5d-4c32d890651e req-4c641a6f-f1a3-4f51-8548-ec3bc5707197 service nova] Creating event network-vif-plugged:faceb057-7205-4f60-9de5-e4f95841e5ad for instance 62ecf924-4cfd-40a6-8d24-66b488062838 on hv-cinder-79578 May 13 13:58:18.921825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-91f128cd-e9e0-4d20-8c5d-4c32d890651e req-4c641a6f-f1a3-4f51-8548-ec3bc5707197 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029841 May 13 13:58:18.922534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 494/981] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:19.818220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:19.818832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:19.825973 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:19.826453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:19.827224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:19.827660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:19.968920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:19.980289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c862f4d1-50b4-497b-91c4-6469785f600a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.166391 May 13 13:58:19.981108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 488/982] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:19 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:21.006400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:21.007426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:21.018061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:21.018788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:21.019559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:21.019988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:21.159147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:21.167264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-53f7f306-2a3a-43fa-b224-18d434e598fd tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1366 microversion: 2.1 time: 0.169058 May 13 13:58:21.168098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 495/983] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:20 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:22.188243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:22.189246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:22.196425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.196878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.197629 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.198079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.338317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:22.346293 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bc1f2470-3793-4d9e-be5f-9421e719dba1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1556 microversion: 2.1 time: 0.164638 May 13 13:58:22.346873 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 489/984] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:58:22 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:22.364273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:22.364826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:22.371590 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.372027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.372792 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.373226 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.460346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f56ab7d4-068c-43d2-8f0a-efcc92f1ece9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099768 May 13 13:58:22.461223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 496/985] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 13:58:22 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:23.498759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-89d8c49a-d343-412e-9c93-1b654bd97dcf req-ed77deee-a9f0-4aa5-91a5-0066ddb3363d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ecf924-4cfd-40a6-8d24-66b488062838", "tag": "faceb057-7205-4f60-9de5-e4f95841e5ad"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:23.507748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-89d8c49a-d343-412e-9c93-1b654bd97dcf req-ed77deee-a9f0-4aa5-91a5-0066ddb3363d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:23.508192 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-89d8c49a-d343-412e-9c93-1b654bd97dcf req-ed77deee-a9f0-4aa5-91a5-0066ddb3363d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:23.520133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-89d8c49a-d343-412e-9c93-1b654bd97dcf req-ed77deee-a9f0-4aa5-91a5-0066ddb3363d service nova] Creating event network-changed:faceb057-7205-4f60-9de5-e4f95841e5ad for instance 62ecf924-4cfd-40a6-8d24-66b488062838 on hv-cinder-79578 May 13 13:58:23.525356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-89d8c49a-d343-412e-9c93-1b654bd97dcf req-ed77deee-a9f0-4aa5-91a5-0066ddb3363d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030471 May 13 13:58:23.525994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 490/986] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:01.460411 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:01.461379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:01.469314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.469771 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.470579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.471013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.494222 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a6fa70e0-784f-4387-a1ad-5e5b8dddcf38 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/ips" status: 200 len: 152 microversion: 2.20 time: 0.041784 May 13 13:59:01.494791 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 497/987] 10.222.0.24 () {60 vars in 1288 bytes} [Fri May 13 13:59:01 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:59:04.447988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:04.448784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:04.459680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.460364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.461636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.462357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.486383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lazy-loading 'flavor' on Instance uuid 3f967688-e7d6-442a-ac8b-1808e31009d0 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:59:04.764754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-554e63d5-1fcf-4502-8bc0-3384fcba52cc tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/action" status: 202 len: 0 microversion: 2.20 time: 0.324930 May 13 13:59:04.765411 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 491/988] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 13 13:59:04 2022] POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:59:04.773828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:04.774438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:04.781518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.781948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.782934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.783364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.915724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.927048 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.928983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.930637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a865b7da-bc71-4f6d-bd4f-4fb744de67a8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.160601 May 13 13:59:04.931434 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 498/989] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:04 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:05.956351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:05.957154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:05.965108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.965851 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:05.966737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.967174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:06.119999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:06.129155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:06.130691 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:06.131875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-31d3d9eb-142a-4aa7-bdb7-ce91dfecabc9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.181322 May 13 13:59:06.132448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 492/990] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:05 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:07.154314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:07.155533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:07.166376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.167142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.168846 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.168997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.331902 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.339875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.341403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.342591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d95f6c07-4a18-4d54-9432-4f3ccf6dd052 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.194997 May 13 13:59:07.343139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 499/991] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:07 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:08.361537 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:08.362215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:08.369294 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.369746 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.370579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.371011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.504792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.513742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.515269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.516441 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3dce1715-24fc-4d7a-898e-e21b3bfefc2c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.158942 May 13 13:59:08.517009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 493/992] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:08 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:09.545633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:09.546376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:09.554853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.555393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.556303 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.556816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.689015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:09.701038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:09.703474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:09.705042 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5f3927be-336e-4990-9e14-f33dfb50b391 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.166397 May 13 13:59:09.705586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 500/993] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:09 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:10.728107 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:10.728710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:10.736526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:10.736980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:10.737787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:10.738226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:10.870598 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.878666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.880163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.881336 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-beed9177-1a0d-434a-9aa1-de6ba4a0c9c9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.159773 May 13 13:59:10.881871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 494/994] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:10 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:11.901314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:11.901920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:11.909290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.909684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.910493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.910939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.045248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.053750 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.055299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.056459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-25bf1bc6-e335-4cda-920b-033ba922e717 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.159146 May 13 13:59:12.057034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 501/995] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:11 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:13.079366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:13.080344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:13.090083 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.090630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:13.091945 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.092655 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:13.242276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:13.254952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:13.257183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:13.258922 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d644afa1-7d74-43fb-9bcd-5513bb29710a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.185969 May 13 13:59:13.259656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 495/996] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:13 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:14.280913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:14.281584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:14.289950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:14.290682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:14.291906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:14.292588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:14.436767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.445308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.446837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.447993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1fb0f525-cb3d-43c8-a54a-6336a839d256 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.172608 May 13 13:59:14.448570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 502/997] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:14 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:15.475604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:15.476360 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.484310 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.484763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.485538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.485971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.630822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.639342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.640841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.642006 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c8dd2aed-ece1-4e89-9ba8-d071e51a9e4c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.173007 May 13 13:59:15.642602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 496/998] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:15 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:16.665131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:16.666152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:16.676874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.677510 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.678808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.679447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.708376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:59:16.709044 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 13:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 (ip 10.222.0.24) !!! May 13 13:59:16.894139 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:16.901985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:16.903631 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:16.905140 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-603418d3-83a7-46b4-886e-64c9e7847cc1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.246258 May 13 13:59:16.905697 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 503/999] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:16 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:17.927886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:17.928811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:17.944488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:17.944488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:17.945069 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:17.945712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.110169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.120344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.120837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.122021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7aa319a9-43d7-40ad-a8c7-35eaf8fea9e5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1745 microversion: 2.20 time: 0.201226 May 13 13:59:18.122636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 497/1000] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:17 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:19.146296 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:19.146911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:19.156596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.157230 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.158322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.158762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.329060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:19.337337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:19.338880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:19.340072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-30d02ad8-48f7-4979-ab35-f0fc69710590 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1745 microversion: 2.20 time: 0.197864 May 13 13:59:19.340649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 504/1001] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:19 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:20.361264 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:20.361859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:20.368562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:20.369022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:20.369772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:20.370238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:20.559353 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.571348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.573778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.575533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-22adb235-adfd-48f3-a630-ed3303507166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1745 microversion: 2.20 time: 0.219210 May 13 13:59:20.576410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 498/1002] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:20 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:21.177877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-ffd1df2c-d944-4ff1-9f11-615b6e65f4d7 req-14be3a83-3d95-4d37-b77e-6cbb35bfea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "name": "network-vif-plugged", "status": "completed", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:21.188179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-ffd1df2c-d944-4ff1-9f11-615b6e65f4d7 req-14be3a83-3d95-4d37-b77e-6cbb35bfea7a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.188808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-ffd1df2c-d944-4ff1-9f11-615b6e65f4d7 req-14be3a83-3d95-4d37-b77e-6cbb35bfea7a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.200740 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-ffd1df2c-d944-4ff1-9f11-615b6e65f4d7 req-14be3a83-3d95-4d37-b77e-6cbb35bfea7a service nova] Creating event network-vif-plugged:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 13:59:21.206638 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-ffd1df2c-d944-4ff1-9f11-615b6e65f4d7 req-14be3a83-3d95-4d37-b77e-6cbb35bfea7a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 May 13 13:59:21.207275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 505/1003] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:21.449654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:59:21.450550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 13:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:59:21.752678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:21.753301 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:21.759847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.760303 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.761082 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.761521 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.902710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.913492 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.915014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.916196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-17f2504c-4b55-4886-9621-87aabc8166b9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1745 microversion: 2.20 time: 0.318728 May 13 13:59:21.916717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 499/1004] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:21 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:22.939441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:22.940446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:22.949835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.950505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.951571 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.952179 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.090939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.098951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.100453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.101621 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e21832ab-4c63-4702-8a99-edbd4045f3f8 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1745 microversion: 2.20 time: 0.169065 May 13 13:59:23.102263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 506/1005] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:22 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:24.119955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:24.120560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:24.127332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.127779 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.128544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.129014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.261720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.270258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.271752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.273283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-297bd472-d013-4f1f-b277-5aeb18c2ebe1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.157512 May 13 13:59:24.273843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 500/1006] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:24 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:25.292640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:25.293419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:25.300657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.301424 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.302476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.303120 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.450299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:25.458994 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:25.460487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:25.461725 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9f4a97cf-69af-464e-9e99-851c2a9c88a2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.173365 May 13 13:59:25.472606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 507/1007] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:25 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:26.480210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:26.480843 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:26.488485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:26.488936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:26.489722 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:26.490197 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:26.630136 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.638160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.639908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.641181 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7c6ed1a9-c40a-411e-b092-02dbddf0b89f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.164980 May 13 13:59:26.641942 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 501/1008] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:26 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:27.660558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:27.662031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:27.668805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:27.669344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:27.670209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:27.670710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:27.821724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.832612 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.832928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.834251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e00887dd-8acd-443c-8dab-fecf8c637de4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.177586 May 13 13:59:27.834835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 508/1009] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:27 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:28.854168 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:28.856625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:28.862661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.863250 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.864041 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.864649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:29.011331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:29.022111 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:29.023615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:29.024828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3e0a7d3b-3598-407d-a522-90c8ba47b65a tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.176189 May 13 13:59:29.025383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 502/1010] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:28 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:30.044794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:30.045367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:30.053369 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.053877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.054680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.055114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.191981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.200261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.201739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.202928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0d2937d2-d488-4e0f-864b-148d22dbfa5b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.162220 May 13 13:59:30.203650 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 509/1011] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:30 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:31.221551 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:31.222376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:31.229757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:31.230576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:31.231380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:31.231819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:31.377258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:31.386625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:31.389011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:31.390362 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-23f15ac7-559f-49b1-acb2-09b20c4e1509 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.173395 May 13 13:59:31.392786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 503/1012] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:31 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:32.411227 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:32.412644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:32.419809 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.420588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.421652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.422181 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.568894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.577453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.580925 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.584295 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2efb0678-c890-4d75-9859-7ad1f08971bb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.177489 May 13 13:59:32.585087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 510/1013] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:32 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:33.603610 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:33.604226 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:33.611075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.611772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.612300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.612783 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.755664 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.771700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.774217 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.775427 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-309d288b-fdc8-4e02-95e0-0b8e464883c5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.175830 May 13 13:59:33.776203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 504/1014] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:33 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:34.795287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:34.795862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:34.802587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.803042 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.803775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.804218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.945878 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.954071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.955750 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.957030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1162f8f6-de50-471b-b99d-093536da56c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.165678 May 13 13:59:34.958008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 511/1015] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:34 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:35.976524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:35.977418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:35.984153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:35.984608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:35.985409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:35.985868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:36.124566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.133735 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.135300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.136668 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-efc52ee4-2338-4237-8187-354c47eef399 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.164201 May 13 13:59:36.137709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 505/1016] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:35 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:37.160054 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:37.161026 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:37.171840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.172622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.173879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.174664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.313561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.325917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.328356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.330182 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-eff55045-6249-4afd-8981-5da13b8ec519 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.176865 May 13 13:59:37.331095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 512/1017] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:37 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:38.353581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:38.355017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:38.365935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.366785 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:38.367999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.368718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:38.513300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.521759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.523286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.524456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-02414ae0-ede9-4aa8-8bd0-92fd6bf6d558 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.178101 May 13 13:59:38.525043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 506/1018] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:38 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:39.548573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:39.549479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:39.556862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:39.557314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:39.558169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:39.558595 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:39.694165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.702818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.704322 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.705473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d8347cd8-3dac-4bdf-a3dc-113439d63851 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.164016 May 13 13:59:39.706002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 513/1019] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:39 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:40.726149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:40.726724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:40.733710 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:40.734195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:40.734983 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:40.735421 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:40.880792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:40.888759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:40.890305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:40.891475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0a32d4ec-c806-410f-8871-12c960974524 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.170105 May 13 13:59:40.892005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 507/1020] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:40 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:41.910466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:41.911096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:41.918404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.918896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:41.919689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.920294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:42.061030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.069359 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.071226 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.072384 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6d29a0ec-daf4-484b-89de-2afc876aa12d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1740 microversion: 2.20 time: 0.166188 May 13 13:59:42.072932 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 514/1021] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:41 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:43.095390 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:43.096381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:43.106819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.107601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.108869 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.109585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.249244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.257826 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.259377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.260548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e963804e-86ed-4fa0-ac59-b2e407a03be7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1722 microversion: 2.20 time: 0.171793 May 13 13:59:43.261115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 508/1022] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:43 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:44.279778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:44.280345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:44.287485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.287928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.288723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.289168 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.426777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.440105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.442512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.444350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1ea252d7-7942-4a7f-89fa-051fe42db378 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1722 microversion: 2.20 time: 0.168583 May 13 13:59:44.444964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 515/1023] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:44 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:45.337447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-8f477fe0-d093-44dc-ae9b-1a9f09da14b2 req-4ad89d3e-3d79-460c-88ec-31c3ccc2ad42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:45.349607 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-8f477fe0-d093-44dc-ae9b-1a9f09da14b2 req-4ad89d3e-3d79-460c-88ec-31c3ccc2ad42 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.350072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-8f477fe0-d093-44dc-ae9b-1a9f09da14b2 req-4ad89d3e-3d79-460c-88ec-31c3ccc2ad42 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.361539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-8f477fe0-d093-44dc-ae9b-1a9f09da14b2 req-4ad89d3e-3d79-460c-88ec-31c3ccc2ad42 service nova] Creating event network-vif-unplugged:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 13:59:45.366968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-8f477fe0-d093-44dc-ae9b-1a9f09da14b2 req-4ad89d3e-3d79-460c-88ec-31c3ccc2ad42 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034121 May 13 13:59:45.367490 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 509/1024] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:45.464000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:45.464763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:45.473739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.474376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.475473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.476796 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.620294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:45.629502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:45.631264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:45.632772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b9531f0b-7c05-4c2a-9345-a1e7b2e63a8e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1725 microversion: 2.20 time: 0.174429 May 13 13:59:45.636397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 516/1025] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:45 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:45.652196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18bb0e0b-066b-4557-9a67-619b75f4c402"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:45.653385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:45.660465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.661580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.662596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.663238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.951985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3dad97a6-0112-4c7b-8504-4ab80f8aa333 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304527 May 13 13:59:45.952578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 510/1026] 10.222.0.24 () {62 vars in 1363 bytes} [Fri May 13 13:59:45 2022] POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:59:46.071141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:46.071815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.080711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.081342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.082553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.083162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.352609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6870c6bb-4e75-4ff3-847f-8b9c121f660c tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments/18bb0e0b-066b-4557-9a67-619b75f4c402" status: 202 len: 0 microversion: 2.20 time: 0.287752 May 13 13:59:46.353163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 517/1027] 10.222.0.24 () {60 vars in 1456 bytes} [Fri May 13 13:59:46 2022] DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments/18bb0e0b-066b-4557-9a67-619b75f4c402 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:59:46.409737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:46.410329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.417386 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.417819 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.418611 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.419043 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.510219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0ad6abd5-0e5b-404d-bfa1-62a2bfe36166 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/action" status: 202 len: 0 microversion: 2.20 time: 0.104399 May 13 13:59:46.510824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 511/1028] 10.222.0.24 () {62 vars in 1318 bytes} [Fri May 13 13:59:46 2022] POST /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:59:46.519075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:46.519830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.527294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.527748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.528541 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.528997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.667518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.675895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.677389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.678584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-02054c9a-5883-4bbc-aa7d-34ed55adf972 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1673 microversion: 2.20 time: 0.163507 May 13 13:59:46.679143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 518/1029] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:46 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:47.698074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:47.698672 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:47.705285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.705738 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.706569 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.707005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.837930 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.846459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.847966 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.849159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0fa1eea8-340c-4f1a-88e3-1d5bf08d9190 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.156021 May 13 13:59:47.849836 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 512/1030] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:47 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:48.869716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:48.870393 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:48.878492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.879302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.880446 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.881092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.029599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:49.037958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:49.039563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:49.040993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c00c2952-0d9d-4391-afb0-dc68ba31f25e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.175738 May 13 13:59:49.041567 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 519/1031] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:48 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:49.691748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66961052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1285115109", "security_groups": [{"name": "tempest-secgroup-smoke-1880576344"}], "block_device_mapping_v2": [{"uuid": "c29f9df0-2640-429b-be29-4e859752ae06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f881359-87c3-427b-a40c-bc9875a283dd"}]}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:49.812438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] validate_networks() for [('9f881359-87c3-427b-a40c-bc9875a283dd', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:59:50.059810 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:50.060413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:50.067556 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.068268 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.069281 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.069906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.209976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.218290 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.219002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:59:50.219574 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:59:50.220198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:59:50.220647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.221579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:59:50.222007 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:59:50.222376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-647ffaea-18a6-44a2-9fb5-7ee48b619062 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.166777 May 13 13:59:50.224096 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 520/1032] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:50 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:50.231709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.232155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.232955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.233396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.249750 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:50.253538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Getting quotas for user 1554793dc7934f9889da636263301ecf and project 5f52886f21f64392889649d64be8b3d3. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:50.311666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:59:50.313812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c29f9df0-2640-429b-be29-4e859752ae06',volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:59:50.471614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-972c3eb7-8e24-4cf1-8569-12f60ae17cf6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783803 May 13 13:59:50.483916 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4d7e3b9e-66d8-40c3-9f55-f119a3c61dd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:50.485150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4d7e3b9e-66d8-40c3-9f55-f119a3c61dd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:50.489829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 513/1033] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 13:59:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:59:50.545559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4d7e3b9e-66d8-40c3-9f55-f119a3c61dd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.552769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4d7e3b9e-66d8-40c3-9f55-f119a3c61dd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1093 microversion: 2.1 time: 0.074136 May 13 13:59:50.559125 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 521/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:50 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:51.243558 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:51.244406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:51.251387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.251842 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.252619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.253055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.394053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.403395 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.405268 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.406520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b4b6e1cc-5c8b-4a2e-9231-a0906bd0a473 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.167746 May 13 13:59:51.407085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 514/1035] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:51 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:51.569401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:51.569967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:51.577522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.577972 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.578775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.579220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.642455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.650276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2f84446a-173c-4f8d-b687-d75f7423f38e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.084833 May 13 13:59:51.650844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 522/1036] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:51 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:52.425861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:52.428056 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:52.436946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.437968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.438874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.439547 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.581673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.591356 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.593001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.594232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-49d12692-edb4-4862-9dd5-e5216b8d377b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.173007 May 13 13:59:52.594814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 515/1037] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:52 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:52.667931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:52.668684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:52.675301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.675778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.676602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.676963 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.738778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.746770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3041451a-cb60-4cee-9b7c-eb3a52a0214c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.082860 May 13 13:59:52.747336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 523/1038] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:52 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:53.612913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:53.613548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:53.622031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.622520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.623321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.623761 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.763911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:53.764655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:53.771058 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.771503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.772301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.772734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.809303 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.817451 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.818968 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.820141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-44920af3-a7b1-4c02-96ef-d39140337975 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.211140 May 13 13:59:53.821027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 516/1039] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:53 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:53.834854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.842989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4dbf80b6-290c-4e73-b186-5d077e8b3b92 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.083104 May 13 13:59:53.843592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 524/1040] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:53 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:54.609996 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.610529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.619889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.620657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-74a34fb7-5389-4969-9f8c-54a0150d72ab req-201e339e-fb74-4764-834b-f8ab7cb086e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:54.628534 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-74a34fb7-5389-4969-9f8c-54a0150d72ab req-201e339e-fb74-4764-834b-f8ab7cb086e9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.629034 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-74a34fb7-5389-4969-9f8c-54a0150d72ab req-201e339e-fb74-4764-834b-f8ab7cb086e9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.638365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.639509 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.639965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.660609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-74a34fb7-5389-4969-9f8c-54a0150d72ab req-201e339e-fb74-4764-834b-f8ab7cb086e9 service nova] Creating event network-changed:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 13:59:54.673630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-74a34fb7-5389-4969-9f8c-54a0150d72ab req-201e339e-fb74-4764-834b-f8ab7cb086e9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057110 May 13 13:59:54.674287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 525/1041] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 13:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:54.678822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:59:54.766778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-00a2133d-ad89-4fb1-a90e-ceb83f556674 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 204 len: 0 microversion: 2.1 time: 0.160275 May 13 13:59:54.767554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 517/1042] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 13:59:54 2022] DELETE /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:59:54.777547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.778326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.785757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.786270 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.787049 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.787489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.840354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.841549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.848110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.848871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.849792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.850377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.951029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:54.958618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-060360fc-f43d-4c81-805d-27659d19fa67 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.186315 May 13 13:59:54.959522 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 526/1043] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:54.969509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.970989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.977313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.979056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.980130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.980872 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.999787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.008105 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.009723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.011139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4f1e869d-a23e-453b-b7d0-3e43ed663fa2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.175990 May 13 13:59:55.012156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 518/1044] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:55.079686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.090936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8b4fb6d7-6209-485c-8393-fd64572ea2ae tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.130118 May 13 13:59:55.091520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 527/1045] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:55.976809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:55.977420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:55.984108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.984554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.985331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.985764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.030183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.030788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.037209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.037652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.038461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.038891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.124041 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.140499 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4177977c-5e36-44ab-a1a6-d54ef37f057a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.166590 May 13 13:59:56.153374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 519/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:55 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:56.159144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.159748 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.167295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.167737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.168704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.169218 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.197907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.206937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.209215 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.210438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-814b017c-a56f-44a2-ac0f-f3d0a5b117c6 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.184629 May 13 13:59:56.211000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 528/1047] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:56.233484 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.241403 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d8d616cd-2505-4d40-9511-48cdfa8e477a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.086023 May 13 13:59:56.242270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 520/1048] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:57.161052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:57.162368 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:57.171815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.172272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.173052 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.173506 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.230244 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:57.231608 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:57.238810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.239350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.240338 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.240887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.322500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.338730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7bf314cb-c491-42d3-a463-c8cb77e11465 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.181348 May 13 13:59:57.339905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 529/1049] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:57 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:57.352817 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:57.353815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:57.360734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.361559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.362623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.363137 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.390719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.398874 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.400361 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.401536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e965cb8a-2716-4342-a25c-99bb63e9ae7f tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.176043 May 13 13:59:57.402200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 521/1050] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:57 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:57.425403 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.432824 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-95ff6701-fa1e-4402-89fe-7d0d6063f9e7 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.083811 May 13 13:59:57.433528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 530/1051] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:57 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:58.356633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.357350 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.363800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.364250 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.365018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.365453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.420886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.421610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.428886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.429297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.430156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.430576 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.507835 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.515705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-12a01a0f-348a-4a88-951c-6a02fc576269 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.163555 May 13 13:59:58.516306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 522/1052] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:58.520911 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.522020 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.530454 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.530963 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.531899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.532343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.582519 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.595341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.596860 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.598132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-50f3fdb0-4967-4cfe-9e3b-a890c277f39e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.181625 May 13 13:59:58.598692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 531/1053] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:58.607818 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.615299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-69a8d280-9cbe-471e-ad42-250b09e62da9 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.098054 May 13 13:59:58.615825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 523/1054] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:59.533834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.534585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.541362 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.541805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.542596 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.543027 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.620587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.622286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.630376 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.631287 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.632278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.632936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.697787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.705985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9b329613-4839-4023-b890-424ca95c1330 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.176772 May 13 13:59:59.713633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 532/1055] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:59.718912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.719516 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.726018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.726503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.727293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.727734 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.796855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.804945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-571581de-2659-4123-8860-26ff5baa6447 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.090173 May 13 13:59:59.805533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 533/1056] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:59.810485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.822613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.824123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.825337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-42f0db29-cc38-439b-9f10-fe0259d2cd59 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.209709 May 13 13:59:59.826947 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 524/1057] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:00.734650 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.735416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.742636 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.743112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.743873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.744308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.823201 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.823872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.830924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.831379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.832164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.832604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.879835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:00.887381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-815ca62b-de99-4c34-a1c1-40c7c20f35b1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.159380 May 13 14:00:00.887968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 534/1058] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:00.892501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.893094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.894849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:00.899202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.899643 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.900431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.900857 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.902940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ee898678-1083-40c1-b31d-f9556a9ab59c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.084182 May 13 14:00:00.903684 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 525/1059] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:01.036575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.045557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.047105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.048273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5e1bb8ad-c5fb-43f5-b4b0-aa8bdf619f85 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.159339 May 13 14:00:01.048836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 535/1060] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:01.909747 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:01.910803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.921694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.922503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.923825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.924524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.925202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:01.926234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.936990 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.937437 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.938236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.938670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.999367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.006981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-803c6e4a-2b67-4577-bffe-5ff45368d76e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.088941 May 13 14:00:02.007560 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 536/1061] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:01 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:02.059911 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.068265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-355f88e4-1392-430e-8a17-779bc3528cf8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.165735 May 13 14:00:02.068627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:02.068866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 526/1062] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:01 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:02.069409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:02.075493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.075972 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.076883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.077488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.224602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.232970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.234547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.235708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a766d048-9106-43c9-bfec-3a78d5c658b5 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.172454 May 13 14:00:02.236245 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 537/1063] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:02 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:00:03.025347 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.025957 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.033254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.033705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.034520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.034958 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.084984 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.085600 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.092401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.092828 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.093650 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.094082 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.102681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.111248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ce50df76-3800-4af1-89ad-a9346b78ab5e tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.089799 May 13 14:00:03.111965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 527/1064] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:03.231547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.239508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-059c4177-6d71-4042-a6af-e9ed3f412f87 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.158398 May 13 14:00:03.240091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 538/1065] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:03.255832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.256552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.265827 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.266426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.267468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.267912 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.415944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.424332 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.425817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.427014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-12f5eca6-7c02-4cea-9deb-090ba07194a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.176748 May 13 14:00:03.427546 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 528/1066] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:04.130000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:04.130654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:04.139477 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.139874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.141038 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.141663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.211375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.218714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-17f0000b-002b-4d56-9a6c-d23de4a44b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.092813 May 13 14:00:04.219282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 539/1067] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:04 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:04.259299 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:04.260004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:04.268222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.268674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.269443 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.269884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.400321 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.408183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-029404f3-5b4f-4a1f-89f1-70e4ad0fb3b4 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.154902 May 13 14:00:04.408765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 529/1068] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:04 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:04.445009 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:04.445620 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:04.452261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.452719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.453490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.453929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.591875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.601119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.602703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.603989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dadf4896-d614-4a18-84b0-216e1c43d03b tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.162940 May 13 14:00:04.604563 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 540/1069] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:04 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:05.236641 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.237371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.243918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.244403 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.245243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.245788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.316837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.324624 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-af82a2db-16a0-4ec3-aa44-3c5f4cd382b1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.092297 May 13 14:00:05.325184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 530/1070] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:05.433564 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.434558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.441911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.442396 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.443153 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.443579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.589062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.596859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-72144a1a-3736-4b06-bb31-66807a54ccad tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.169808 May 13 14:00:05.597433 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 541/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:05.624566 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.625209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.631453 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.631899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.632659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.633087 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.768195 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.776342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.779590 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.780824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fbdc48e1-840d-4793-9603-227e7e66a7f2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.160347 May 13 14:00:05.781391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 531/1072] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:06.341763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.342423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.349078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.349529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.350347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.350782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.411134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.418768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fe847333-01c2-47d4-b6d3-4db0c765af6a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1143 microversion: 2.1 time: 0.080980 May 13 14:00:06.419348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 542/1073] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:06.619438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.620016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.627035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.627486 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.628251 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.628665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.763580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.771374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0665e77f-ae17-469c-914d-360267514bd8 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.156047 May 13 14:00:06.771938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 532/1074] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:06.799476 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.800092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.806887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.807337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.808102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.808598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.952413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.960350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.961865 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.963057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-120396a8-4ec8-47f3-8369-7ccf91788c70 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.167567 May 13 14:00:06.963593 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 543/1075] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:07.439897 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.440896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:07.451274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.451700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.452488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.452919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.516514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:07.524034 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-eba518e1-095d-4880-b6f8-109001f0c1d0 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1135 microversion: 2.1 time: 0.090764 May 13 14:00:07.524614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 533/1076] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:07 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:07.793123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.794106 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:07.805518 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.806549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.807569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.808296 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.942274 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:07.950203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-78d743b4-94af-4bf3-bdc0-e80d9ed8710e tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.163786 May 13 14:00:07.950789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 544/1077] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:07 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:07.980950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.981562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:07.988793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.989249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.990652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.991162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.125685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:08.134064 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:08.135596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:08.136778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-138f48be-9218-46e1-a96c-34871ab8c455 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.159825 May 13 14:00:08.137349 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 534/1078] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:07 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:08.544257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:08.545156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:08.554481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.555094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.556156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.556784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.622448 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:08.630028 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c86f2ae7-51c0-473c-a202-66d54c3e8b17 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1135 microversion: 2.1 time: 0.091629 May 13 14:00:08.630630 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 545/1079] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:08 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1135 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:08.973506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:08.974205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:08.981306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.982009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.982823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.983279 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.127114 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:09.135459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-54a5e2ab-9f03-45af-941a-a46ebbb6225f tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.166321 May 13 14:00:09.136020 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 535/1080] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:08 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:09.160545 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:09.161119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:09.167871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.168311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.169066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.169492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.305944 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:09.314646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:09.316116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:09.317299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2144824c-9259-4f92-b9d9-7ee73358d7cb tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.160668 May 13 14:00:09.317888 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 546/1081] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:09 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:09.654382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:09.655822 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:09.667174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.667967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.669242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.670184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.741929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:09.753581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6c8fa8af-e124-4226-aece-f5f498be2b31 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1135 microversion: 2.1 time: 0.106051 May 13 14:00:09.754492 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 536/1082] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:09 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1135 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:10.153074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:10.153980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:10.160466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.160912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.161664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.162132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.302934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.311251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e4bc0197-b909-424b-b8bf-bdcd38e6aada tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1565 microversion: 2.1 time: 0.162103 May 13 14:00:10.312655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 547/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:10 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:10.340067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:10.341669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:10.350176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.350716 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.351578 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.353204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.500712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.508987 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.510787 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.512150 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b9d8c213-423d-4846-a0e8-86d3cc89f49e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.179560 May 13 14:00:10.512872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 537/1084] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:10 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:10.772893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:10.773512 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:10.780442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.781889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.782709 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.783672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.865010 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.873851 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7e26c879-cf24-4f5f-8773-e43682af3bd2 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1191 microversion: 2.1 time: 0.105301 May 13 14:00:10.875209 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 548/1085] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:10 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:11.331268 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:11.332660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:11.340181 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.341366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.342675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.343646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.461797 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-711167e2-6bbd-43de-a1eb-f7d4fb9f880b req-b1da75d7-eba1-4e89-af35-12b2dc1b23e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8823cc-14a9-477a-b4bc-0e67d4c6925c", "name": "network-vif-deleted", "tag": "1a06e185-f2c8-438f-a115-cd6fb005183c"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:11.462295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:11.471091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-711167e2-6bbd-43de-a1eb-f7d4fb9f880b req-b1da75d7-eba1-4e89-af35-12b2dc1b23e9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.471533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-711167e2-6bbd-43de-a1eb-f7d4fb9f880b req-b1da75d7-eba1-4e89-af35-12b2dc1b23e9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.474128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bdb96be1-6f72-43aa-924f-6e67e248fa7a tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1380 microversion: 2.1 time: 0.148499 May 13 14:00:11.475066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 538/1086] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:11 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1380 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:11.494606 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-711167e2-6bbd-43de-a1eb-f7d4fb9f880b req-b1da75d7-eba1-4e89-af35-12b2dc1b23e9 service nova] Creating event network-vif-deleted:1a06e185-f2c8-438f-a115-cd6fb005183c for instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c on hv-cinder-79578 May 13 14:00:11.501634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-711167e2-6bbd-43de-a1eb-f7d4fb9f880b req-b1da75d7-eba1-4e89-af35-12b2dc1b23e9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044164 May 13 14:00:11.502652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 549/1087] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:11.532531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:11.533144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:11.539378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.539829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.540597 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.541027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.727964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:11.740526 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:11.742512 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:11.743786 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6caf2e1f-0012-47a1-8078-83779881a8ef tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.215776 May 13 14:00:11.755575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 539/1088] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:11 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:00:11.891936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:11.893003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:11.900416 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.900855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.902164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.902889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.106909 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.117201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-262dced7-d0c4-4b43-b49e-07265c968ce8 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1277 microversion: 2.1 time: 0.229457 May 13 14:00:12.117923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 550/1089] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:11 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:12.491507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:12.492129 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:12.498849 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.499300 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.500322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.500930 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.551295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.552490 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.553165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lazy-loading 'fault' on Instance uuid 9f8823cc-14a9-477a-b4bc-0e67d4c6925c {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:12.623462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce99b3b5a74442b8a0caa85e22b88401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8ad4362c094e9aa489ebb4c20fd388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.632207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7bc3e607-8413-4bd6-809c-95bbbc6f30a1 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 200 len: 1176 microversion: 2.1 time: 0.144943 May 13 14:00:12.633123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 540/1090] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:12 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 1176 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:12.762675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:12.763292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:12.771340 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.771988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.772965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.773811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.929491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.938786 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.940293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.941486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e1805b5d-f953-4517-a836-5fc40ec0d9a1 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.182776 May 13 14:00:12.942079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 551/1091] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:12 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:13.134908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.135589 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:13.142140 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.142689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.143379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.143814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.326501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:13.334084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7ece4f2a-4eee-455d-92ec-c6fad8603444 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.203179 May 13 14:00:13.334657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 541/1092] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:13 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:13.525479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-bd8a4011-640b-468b-b792-bd08a712ff94 req-8ad8b5be-b378-4b6e-935b-acb3e916b3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c1589f-3497-4539-ba14-182a1d5ae653", "tag": "fdf14eda-20ce-4082-84be-e61a4cc52631"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:13.537674 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-bd8a4011-640b-468b-b792-bd08a712ff94 req-8ad8b5be-b378-4b6e-935b-acb3e916b3a9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.538425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-bd8a4011-640b-468b-b792-bd08a712ff94 req-8ad8b5be-b378-4b6e-935b-acb3e916b3a9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.552488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-bd8a4011-640b-468b-b792-bd08a712ff94 req-8ad8b5be-b378-4b6e-935b-acb3e916b3a9 service nova] Creating event network-changed:fdf14eda-20ce-4082-84be-e61a4cc52631 for instance 75c1589f-3497-4539-ba14-182a1d5ae653 on hv-cinder-79578 May 13 14:00:13.557665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-bd8a4011-640b-468b-b792-bd08a712ff94 req-8ad8b5be-b378-4b6e-935b-acb3e916b3a9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036802 May 13 14:00:13.558280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 552/1093] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:13.654518 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.655478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] [instance: 9f8823cc-14a9-477a-b4bc-0e67d4c6925c] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:13.662816 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.663270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.664034 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.664469 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.678613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] HTTP exception thrown: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Request method failure captured: May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c HTTP/1.1 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmLB6G-EbpfqPAzRFMhezBREvrirWB4uj_JQp6EJIaahIg-D6rexV_mIP_VBt48nf3r6DqnTpXo5aodQod7Viy67CfKjmr26E9ExcAN97QsPu9Bw2bkkEGawHzKdIt4vFkPytE-CRYukiImXn0r4Q83BLMNQkoLp3zBwBN-FSD_j724 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: ed8ad4362c094e9aa489ebb4c20fd388 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestShelveInstance-36491751 May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:00:13.680248 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ed8ad4362c094e9aa489ebb4c20fd388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ed8ad4362c094e9aa489ebb4c20fd388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ed8ad4362c094e9aa489ebb4c20fd388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ed8ad4362c094e9aa489ebb4c20fd388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestShelveInstance-36491751 May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: ed8ad4362c094e9aa489ebb4c20fd388 May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestShelveInstance-36491751 May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestShelveInstance-36491751-project May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: ce99b3b5a74442b8a0caa85e22b88401 May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestShelveInstance-36491751-project May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. May 13 14:00:13.681876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '9f8823cc-14a9-477a-b4bc-0e67d4c6925c'} May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:13.682979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. May 13 14:00:13.684491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:13.686028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Returning 404 to user: Instance 9f8823cc-14a9-477a-b4bc-0e67d4c6925c could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:13.686028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-edfa7022-251a-4b8f-85c3-822ab1bfba08 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c" status: 404 len: 111 microversion: 2.1 time: 0.034150 May 13 14:00:13.686028 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 542/1094] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:13 2022] GET /compute/v2.1/servers/9f8823cc-14a9-477a-b4bc-0e67d4c6925c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:13.848528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-172ba4ff-d8d5-4160-bdd0-0d1a5f4859b9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] Calling method '.version_select at 0x7ff15418a160>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.871220 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-172ba4ff-d8d5-4160-bdd0-0d1a5f4859b9 tempest-TestShelveInstance-36491751 tempest-TestShelveInstance-36491751-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1901887802" status: 202 len: 0 microversion: 2.1 time: 0.027243 May 13 14:00:13.872161 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 553/1095] 10.222.0.24 () {58 vars in 1253 bytes} [Fri May 13 14:00:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1901887802 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:13.959889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.960497 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:13.966534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.966985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.967792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.968263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.194908 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:14.210323 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:14.212097 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:14.213539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-77e7357e-f0a0-46e4-afdd-42cd7de4832e tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.257647 May 13 14:00:14.214695 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 543/1096] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:13 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:14.263665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-422c020b-be20-48d2-86bf-e616d596c8f2 req-7149cf48-d4ab-4407-a867-e4e5c9678be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "name": "network-vif-plugged", "status": "completed", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:14.274008 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-422c020b-be20-48d2-86bf-e616d596c8f2 req-7149cf48-d4ab-4407-a867-e4e5c9678be9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.274875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-422c020b-be20-48d2-86bf-e616d596c8f2 req-7149cf48-d4ab-4407-a867-e4e5c9678be9 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.286385 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-422c020b-be20-48d2-86bf-e616d596c8f2 req-7149cf48-d4ab-4407-a867-e4e5c9678be9 service nova] Creating event network-vif-plugged:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 14:00:14.291521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-422c020b-be20-48d2-86bf-e616d596c8f2 req-7149cf48-d4ab-4407-a867-e4e5c9678be9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091709 May 13 14:00:14.292208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 554/1097] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:00:14.351147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:14.351762 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:14.357785 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.358280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.359108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.359586 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.615292 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:14.623074 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9f525d44-b4af-4c55-a24d-a26c75d7e990 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.275973 May 13 14:00:14.623637 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 544/1098] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:14 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:15.238150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:15.238997 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:15.247561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.248177 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.249087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.249753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.389074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:15.398253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:15.399870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:15.401121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6221cb67-b362-4652-9870-378c3102aa68 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.172397 May 13 14:00:15.401773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 555/1099] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:15 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:15.640219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:15.641093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:15.648357 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.649018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.650009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.650477 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.877047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:15.884989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c86bde86-30cc-41ee-bbd8-041021cdc228 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.248807 May 13 14:00:15.885656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 545/1100] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:15 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:16.315490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:16.316013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:16.321938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.322714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.323493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.323926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.347127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a14ee352-30b6-40f0-a161-43a4fae86350 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/ips" status: 200 len: 146 microversion: 2.1 time: 0.171493 May 13 14:00:16.347690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 556/1101] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:00:16 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/ips => generated 146 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:16.423339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:16.423935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:16.433752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.434398 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.435341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.436094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.689516 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:16.698220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:16.700087 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:16.701536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-796d610a-bf7f-418d-bd9a-73808b3ad7ac tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.284512 May 13 14:00:16.702918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 546/1102] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:16 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:16.901514 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:16.902156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:16.908406 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.908854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.909654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.910110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.052775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:17.061839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5d2f40ad-cd84-46b6-88b9-1c03aadbe49b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.164067 May 13 14:00:17.063088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 557/1103] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:16 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:17.720325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:17.724720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:17.733288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.748173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.749417 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.750917 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.064231 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.074660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.078026 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.079550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ed0a5979-daba-4b4c-ba30-da721b0b9e61 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1731 microversion: 2.20 time: 0.363284 May 13 14:00:18.080985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 547/1104] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:17 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:18.092529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:18.093920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:18.100193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.100640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.101408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.101834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.285834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.293428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-52767332-6c92-44e8-8a6b-7858a95367cb tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.214959 May 13 14:00:18.294297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 558/1105] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:18 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:18.770309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a70dd419-32ae-4758-864b-08e7a9708904"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:18.771560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:18.778224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.779318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.780175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.780829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.061897 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-39f51f33-d04d-47f7-a641-4d882964cf21 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295399 May 13 14:00:19.063324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 548/1106] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:00:18 2022] POST /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:19.098728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:19.099701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:19.108875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.109720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.111108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.111890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.275123 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.287481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.293975 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.295399 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f1328e6d-6efb-41e8-b4db-90b17e5b0863 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1718 microversion: 2.20 time: 0.200948 May 13 14:00:19.302085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 559/1107] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:00:19 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1718 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:19.316337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:19.317724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:19.329725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.330175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.331158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.331599 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.539637 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.548765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cd7dde9f-42e5-41e8-bd67-073e5eb70c05 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.239326 May 13 14:00:19.549433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 549/1108] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:19 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:20.568856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:20.569466 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:20.576279 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.576735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.578452 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.578901 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.735414 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:20.745716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e0ddb502-422c-45ff-9681-47650bb9f355 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.180675 May 13 14:00:20.747621 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 560/1109] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:20 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:21.765318 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:21.767160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:21.775612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:21.776529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:21.777481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:21.778105 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.100998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:22.108900 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e631c042-1eab-4bb2-8b42-3f361788c557 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.348306 May 13 14:00:22.109482 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 550/1110] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:21 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:23.126066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:23.126813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:23.133868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.134777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.135398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.136003 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.275663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:23.284706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-85d2ef73-235d-44ec-864a-97e412ee7a0d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.162942 May 13 14:00:23.285306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 561/1111] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:23 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:24.304344 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:24.304927 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:24.311728 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.312180 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.312965 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.313435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.457149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:24.464639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ea6d6fc0-91d7-4bb3-a730-547cada7bb73 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.164346 May 13 14:00:24.465312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 551/1112] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:24 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:25.484483 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:25.485557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:25.492575 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:25.493031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:25.493814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:25.494316 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:25.632812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:25.640451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a3a24b9a-32e7-4ef3-a55f-3b89b37a2219 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.162387 May 13 14:00:25.641061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 562/1113] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:25 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:26.090613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-38dc162f-0ec2-41ba-93d8-765e43aa8f5c req-c086a52f-752c-47c8-82d1-6ed365d9728c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c1589f-3497-4539-ba14-182a1d5ae653", "name": "network-vif-plugged", "status": "completed", "tag": "fdf14eda-20ce-4082-84be-e61a4cc52631"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:26.105510 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-38dc162f-0ec2-41ba-93d8-765e43aa8f5c req-c086a52f-752c-47c8-82d1-6ed365d9728c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:26.105935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-38dc162f-0ec2-41ba-93d8-765e43aa8f5c req-c086a52f-752c-47c8-82d1-6ed365d9728c service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:26.128182 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-38dc162f-0ec2-41ba-93d8-765e43aa8f5c req-c086a52f-752c-47c8-82d1-6ed365d9728c service nova] Creating event network-vif-plugged:fdf14eda-20ce-4082-84be-e61a4cc52631 for instance 75c1589f-3497-4539-ba14-182a1d5ae653 on hv-cinder-79578 May 13 14:00:26.133208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-38dc162f-0ec2-41ba-93d8-765e43aa8f5c req-c086a52f-752c-47c8-82d1-6ed365d9728c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046675 May 13 14:00:26.133824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 552/1114] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:26.659716 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:26.660607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:26.667423 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:26.667873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:26.668637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:26.669074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:26.806964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:26.815386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-99e457c0-cd0b-4f6c-a7c6-831e89d593ef tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.160949 May 13 14:00:26.816076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 563/1115] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:26 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:27.717162 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.718213 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.725531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.725985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.726811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.727250 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.768065 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3ff2aba3-0fbc-456f-b7b8-314ba5fb6e88 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055726 May 13 14:00:27.769053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 553/1116] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:00:27 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:27.781574 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.782223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.789669 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.790412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.791618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.792280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.824782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b90ec5d1-6829-4f5a-96e8-2ce75aa1c261 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904" status: 200 len: 194 microversion: 2.1 time: 0.048127 May 13 14:00:27.825392 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 564/1117] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 13 14:00:27 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:27.832733 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.833339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.839716 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.840166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.840933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.841358 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.972811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:27.980591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6c026296-d3c8-41d4-8c43-e858004a2815 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.151839 May 13 14:00:27.981257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 554/1118] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:27 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:29.001625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:29.002975 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:29.009704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:29.010202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:29.010968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:29.011412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:29.164862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:29.172354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cb3a3a88-fbf2-4ea6-89b6-d4b8dc6be7c5 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1265 microversion: 2.1 time: 0.177169 May 13 14:00:29.172939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 565/1119] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:28 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:30.189101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:30.189719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.196437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.196896 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.197674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.198138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.205980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e25ac16-f89c-4190-945b-6e8b69be8a9e"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:30.207874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.214356 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.214814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.215586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.216023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.340804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:30.349347 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cf6bbca4-162c-443b-8426-e21fefd66c2a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1452 microversion: 2.1 time: 0.164087 May 13 14:00:30.350021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 555/1120] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:30 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:30.366694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:30.367420 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.373884 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.374437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.375223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.375653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.514520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:30.522260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9ee2c0a0-c39b-47ee-a6b3-6d130104cf15 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1452 microversion: 2.1 time: 0.160138 May 13 14:00:30.522840 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 556/1121] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:30 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:30.645218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bb47a54a-590c-453e-9760-97e5f6bde1c0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "POST /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442960 May 13 14:00:30.646068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 566/1122] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:00:30 2022] POST /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:32.466606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-3e2c5420-c078-43a7-ada9-41a95c934b9e req-0df1ac79-7905-4e15-a633-2ee90c20d508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c1589f-3497-4539-ba14-182a1d5ae653", "tag": "fdf14eda-20ce-4082-84be-e61a4cc52631"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:32.475365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-3e2c5420-c078-43a7-ada9-41a95c934b9e req-0df1ac79-7905-4e15-a633-2ee90c20d508 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.475832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-3e2c5420-c078-43a7-ada9-41a95c934b9e req-0df1ac79-7905-4e15-a633-2ee90c20d508 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.487128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-3e2c5420-c078-43a7-ada9-41a95c934b9e req-0df1ac79-7905-4e15-a633-2ee90c20d508 service nova] Creating event network-changed:fdf14eda-20ce-4082-84be-e61a4cc52631 for instance 75c1589f-3497-4539-ba14-182a1d5ae653 on hv-cinder-79578 May 13 14:00:32.492499 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-3e2c5420-c078-43a7-ada9-41a95c934b9e req-0df1ac79-7905-4e15-a633-2ee90c20d508 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029654 May 13 14:00:32.493170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 557/1123] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:33.717598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:33.718187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:33.725497 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:33.725942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.726725 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:33.727184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.755917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0edb3f4c-d31b-4c83-af16-086c7119fdd9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/ips" status: 200 len: 150 microversion: 2.1 time: 0.042917 May 13 14:00:33.756608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 567/1124] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:00:33 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:36.193999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45659754-be72-499a-9345-8aca07469ed1"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:36.195178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:36.201673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.202128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.202889 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.203320 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.492766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-01f0eaea-96a7-4989-a9f8-605e24ceb5a1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303663 May 13 14:00:36.493378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 558/1125] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:00:36 2022] POST /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:39.244590 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:39.245571 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:39.252490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.252938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.253696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.254163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.284793 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cc0e952b-9137-4c89-9a8a-a292d4672c57 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044214 May 13 14:00:39.285344 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 568/1126] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:00:39 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:39.428166 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:39.428717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:39.435689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.436144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.436918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.437409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.469689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f2b816c4-c1c7-4a29-a509-e33c2ee84f79 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904" status: 200 len: 194 microversion: 2.1 time: 0.046016 May 13 14:00:39.470326 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 559/1127] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 13 14:00:39 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:39.480349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:39.480870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:39.487432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.487883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.488695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.489132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.569721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lazy-loading 'services' on Instance uuid 270b4062-876f-4f9b-a400-f9f7d9563aac {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:39.647686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bc5bc551-37b5-4617-8ff1-92163ac7e61d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904" status: 202 len: 0 microversion: 2.1 time: 0.171129 May 13 14:00:39.648305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 569/1128] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:00:39 2022] DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/a70dd419-32ae-4758-864b-08e7a9708904 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:46.118861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c4046d63-ff56-4ca0-bb7a-a78470a9a17a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: .version_select at 0x7ff154181550>, body: {"keypair": {"name": "tempest-keypair-1248807449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOy9sB68zT064nIbO7FJ95j3v7TUVYb3tK7fBZnrKzoTtRKX+Dn8wK5VyYDCanPTf7bscIyKeNIUaa3RG9bSI1RrDQIhWZzK2VXgHJJMnn0MgEBaKrZhsONVk/biSx5bA=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:46.134425 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-c4046d63-ff56-4ca0-bb7a-a78470a9a17a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:00:46.138208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-c4046d63-ff56-4ca0-bb7a-a78470a9a17a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:00:46.167312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c4046d63-ff56-4ca0-bb7a-a78470a9a17a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052739 May 13 14:00:46.167970 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 560/1129] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 14:00:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:47.113700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:47.114360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:47.121754 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.122327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.123101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.123539 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.152376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-33d4a4c3-9805-4f2c-9fe4-6c23d1411913 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/7e25ac16-f89c-4190-945b-6e8b69be8a9e" status: 200 len: 194 microversion: 2.1 time: 0.043598 May 13 14:00:47.153308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 570/1130] 10.222.0.24 () {58 vars in 1412 bytes} [Fri May 13 14:00:47 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/7e25ac16-f89c-4190-945b-6e8b69be8a9e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:47.163935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:47.164478 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:47.171309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.171759 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.172530 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.172935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.253465 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lazy-loading 'services' on Instance uuid 270b4062-876f-4f9b-a400-f9f7d9563aac {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:47.329653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-47ca29a6-22c3-4bbd-b553-57e331c74cc3 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/7e25ac16-f89c-4190-945b-6e8b69be8a9e" status: 202 len: 0 microversion: 2.1 time: 0.170021 May 13 14:00:47.330522 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 561/1131] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:00:47 2022] DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments/7e25ac16-f89c-4190-945b-6e8b69be8a9e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:47.488147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1228331288", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271e298e-b7ac-45a3-816f-485dc01eb596"}], "security_groups": [{"name": "tempest-securitygroup--797418977"}], "key_name": "tempest-keypair-1248807449", "user_data": "}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:47.595812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] validate_networks() for [('271e298e-b7ac-45a3-816f-485dc01eb596', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:00:48.036653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:00:48.037079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:00:48.038265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:00:48.038715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:00:48.039131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:00:48.048289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.048728 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.049486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.049917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.067959 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:00:48.072616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:00:48.085069 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:00:48.087405 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:00:48.137443 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8ae415d6-239c-4e00-b804-817e938f4a8f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653466 May 13 14:00:48.138099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 571/1132] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 14:00:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:00:48.149479 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e12ace95-964d-4c22-bde4-8333d7da740a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.150206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e12ace95-964d-4c22-bde4-8333d7da740a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.207040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e12ace95-964d-4c22-bde4-8333d7da740a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:48.214258 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e12ace95-964d-4c22-bde4-8333d7da740a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1242 microversion: 2.1 time: 0.069743 May 13 14:00:48.215698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 562/1133] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:48.497064 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.498298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.508485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.509070 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.509879 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.510352 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.539399 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0048cf44-1279-4e2c-9c5a-cd5adf85b0bd tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047349 May 13 14:00:48.539938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 572/1134] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:00:48.652646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.654435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.662909 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.663366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.664142 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.664580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.694825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2ca184bd-519b-46b4-a529-77d7df1dfd71 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047355 May 13 14:00:48.695374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 563/1135] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:00:48.755152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.755647 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.762456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.762907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.763692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.764109 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.791085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:00:48.872756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-72043fbb-e428-4ff3-b0d6-db799894478e tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 204 len: 0 microversion: 2.1 time: 0.121021 May 13 14:00:48.873691 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 573/1136] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:00:48 2022] DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:00:48.882237 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.882864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.889012 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.889460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.890255 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.890688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:49.031552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:49.041058 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7ce7e764-2c4f-44fb-81f2-b724954b6949 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1671 microversion: 2.1 time: 0.162711 May 13 14:00:49.041635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 564/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:49.231527 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:49.232102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:49.238849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:49.239294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:49.240050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:49.240474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:49.303429 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:49.310905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a73a93ac-cceb-4b9e-9c4d-39aff142edca tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1294 microversion: 2.1 time: 0.083807 May 13 14:00:49.311500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 574/1138] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:49 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:50.065159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:50.065811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:50.073313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:50.073752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:50.074530 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:50.074991 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:50.218575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:50.229876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e8f67ed7-64c2-42af-ac6c-192d2c2e8675 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1671 microversion: 2.1 time: 0.169481 May 13 14:00:50.230579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 565/1139] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:50 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:50.329147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:50.329907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:50.337005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:50.337456 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:50.338269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:50.338706 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:50.406767 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:50.414960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bab646f8-f40f-4ef9-8218-d3b0160e6472 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1294 microversion: 2.1 time: 0.090232 May 13 14:00:50.415524 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 575/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:50 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:51.250909 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:51.251539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:51.258868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:51.259306 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:51.260088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:51.260519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:51.397105 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:51.405368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bc905d2f-e84e-4a97-95ac-1a2e5b4cf607 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1671 microversion: 2.1 time: 0.158249 May 13 14:00:51.405902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 566/1141] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:51 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:51.431990 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:51.432598 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:51.439713 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:51.440164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:51.440927 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:51.441361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:51.505170 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:51.513013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f28ba25c-ecd8-4563-90a4-604288c4e87a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1300 microversion: 2.1 time: 0.084950 May 13 14:00:51.513568 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 576/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:51 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:52.423383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:52.424018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:52.431383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:52.431837 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:52.432621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:52.433056 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:52.530726 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:52.531284 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:52.538253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:52.538639 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:52.539425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:52.539859 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:52.673261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:52.681457 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-18f429c6-abfe-4357-8082-53a203133fb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.155144 May 13 14:00:52.682149 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 577/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:52 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:52.817009 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:52.825139 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-982b5d76-8897-4345-b872-8369d6bb94db tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1671 microversion: 2.1 time: 0.405782 May 13 14:00:52.826144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 567/1144] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:52 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:53.603208 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-1da1e293-9bd1-4409-9862-c890c0acf475 req-4730ef9b-0302-4cc9-a72e-a4733b2b26c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270b4062-876f-4f9b-a400-f9f7d9563aac", "name": "network-vif-deleted", "tag": "63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:53.654761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1da1e293-9bd1-4409-9862-c890c0acf475 req-4730ef9b-0302-4cc9-a72e-a4733b2b26c1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.656736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1da1e293-9bd1-4409-9862-c890c0acf475 req-4730ef9b-0302-4cc9-a72e-a4733b2b26c1 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.679608 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-1da1e293-9bd1-4409-9862-c890c0acf475 req-4730ef9b-0302-4cc9-a72e-a4733b2b26c1 service nova] Creating event network-vif-deleted:63d8c9a4-5af9-4dcc-aa1d-03859ed1a3f0 for instance 270b4062-876f-4f9b-a400-f9f7d9563aac on hv-cinder-79578 May 13 14:00:53.687811 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-1da1e293-9bd1-4409-9862-c890c0acf475 req-4730ef9b-0302-4cc9-a72e-a4733b2b26c1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101303 May 13 14:00:53.689116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 578/1145] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:53.699952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:53.701656 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:53.714231 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.715036 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.716241 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.716752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.844807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:53.845689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:53.865389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.866144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.867164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.867646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.900659 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:53.901269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:53.901842 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lazy-loading 'fault' on Instance uuid 270b4062-876f-4f9b-a400-f9f7d9563aac {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:53.937777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:53.946613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9d38ad6c-4fb2-4977-af20-fc1cf713a463 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.251568 May 13 14:00:53.950106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 568/1146] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:53 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:53.953091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f789eaddc18244e0a1f8246e6eb21991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a828bec5e46079d85da062846e17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:53.962980 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-073dfcd6-2566-4265-b409-5180320ac9f6 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 200 len: 1326 microversion: 2.1 time: 0.122794 May 13 14:00:53.963704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 579/1147] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:53 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:54.968268 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:54.969111 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:54.980212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:54.980954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:54.982280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:54.983008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:54.984487 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:54.985489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:54.994323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:54.994778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:54.995548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:54.995981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:55.010282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac HTTP/1.1 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:00:55.011945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:55.013397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '270b4062-876f-4f9b-a400-f9f7d9563aac'} May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:55.014341 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:55.015827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:55.016989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:55.016989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6f8558a5-362d-4df6-91ff-f4da3f57ee0d tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 404 len: 111 microversion: 2.1 time: 0.035532 May 13 14:00:55.016989 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 580/1148] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:54 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:55.023131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a7bb397b-5074-458e-a02b-95758820dbd0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '.version_select at 0x7ff15913e940>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:55.043778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a7bb397b-5074-458e-a02b-95758820dbd0 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322917260" status: 202 len: 0 microversion: 2.1 time: 0.025225 May 13 14:00:55.044361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 581/1149] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 14:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322917260 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:55.126585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:55.134312 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1cb7eb13-a64c-4213-80a1-8504eb221ef6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.172625 May 13 14:00:55.134880 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 569/1150] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:54 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:55.702633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-c51772a4-f708-4f0d-974f-045c579ddf02 req-38044d42-f24a-40f6-adcd-276b7fa547ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b1c277-1049-4450-b506-96dff869d8dc", "tag": "4352eab2-ad01-4078-b24d-75fa21a8db75"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:55.712229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-c51772a4-f708-4f0d-974f-045c579ddf02 req-38044d42-f24a-40f6-adcd-276b7fa547ef service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:55.712676 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-c51772a4-f708-4f0d-974f-045c579ddf02 req-38044d42-f24a-40f6-adcd-276b7fa547ef service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:55.725130 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-c51772a4-f708-4f0d-974f-045c579ddf02 req-38044d42-f24a-40f6-adcd-276b7fa547ef service nova] Creating event network-changed:4352eab2-ad01-4078-b24d-75fa21a8db75 for instance 93b1c277-1049-4450-b506-96dff869d8dc on hv-cinder-79578 May 13 14:00:55.731381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-c51772a4-f708-4f0d-974f-045c579ddf02 req-38044d42-f24a-40f6-adcd-276b7fa547ef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 May 13 14:00:55.731816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 582/1151] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:56.154638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:56.155249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:56.165729 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:56.166224 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:56.167027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:56.167459 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:56.302538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:56.310900 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3f032261-4875-4b0d-b48a-7ee139f5fce9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.162840 May 13 14:00:56.311407 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 570/1152] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:56 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:57.329768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:57.330651 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:57.336893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.337331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:57.338121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.338554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:57.471114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:57.479158 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d5b74bc0-30a4-4a17-9c94-64fa2294c110 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.154824 May 13 14:00:57.479736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 583/1153] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:57 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:57.949185 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:57.949741 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:57.956273 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.956728 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:57.957505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.957979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:57.972018 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac HTTP/1.1 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:00:57.973914 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:57.975886 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '270b4062-876f-4f9b-a400-f9f7d9563aac'} May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:57.976804 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:57.978408 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:57.979975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:57.979975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-855917c3-811d-483a-9604-88a9f1db4702 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 404 len: 111 microversion: 2.1 time: 0.030192 May 13 14:00:57.979975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 571/1154] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:00:57 2022] DELETE /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:57.984276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:57.984876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 270b4062-876f-4f9b-a400-f9f7d9563aac] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:57.991363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.991794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:57.992570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:57.993063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:58.006250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac HTTP/1.1 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:00:58.007931 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:58.009502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '270b4062-876f-4f9b-a400-f9f7d9563aac'} May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:58.010538 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. May 13 14:00:58.011987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:58.013773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 270b4062-876f-4f9b-a400-f9f7d9563aac could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:58.013773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-59270981-6633-48e1-8bef-9046158bf13a tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac" status: 404 len: 111 microversion: 2.1 time: 0.028879 May 13 14:00:58.014898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 584/1155] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:57 2022] GET /compute/v2.1/servers/270b4062-876f-4f9b-a400-f9f7d9563aac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:58.497210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:58.497829 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:58.504225 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:58.504803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:58.505585 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:58.506026 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:58.641494 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:58.649504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-220aaac2-6b8a-4828-a91f-9eb2f4a02e10 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.156317 May 13 14:00:58.650088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 572/1156] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:58 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:59.154234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:59.154748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:59.161357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.161815 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.162656 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.163584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.181234 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 HTTP/1.1 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:00:59.183756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.185425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '26fef620-abd7-40d5-a072-6af7a0a22ad0'} May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:59.186473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.188095 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:00:59.189680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:59.189680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-22bbcd35-b4a2-4028-ad72-abe59143bcef tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 404 len: 111 microversion: 2.1 time: 0.035420 May 13 14:00:59.189680 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 585/1157] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:00:59 2022] DELETE /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:59.194550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:59.195196 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] [instance: 26fef620-abd7-40d5-a072-6af7a0a22ad0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:59.201801 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.202296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.203072 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.203508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.217792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] HTTP exception thrown: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Request method failure captured: May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 HTTP/1.1 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHuRa880sGZusGqOgAnZTXKodX5e3yYktSqaR9OfU-F4eJev2GxF38R0XFeO0ZhXSiPIvZoCda8v28e5sVpfVO-QSXQtIxntgopv465ZLKN_hb3I5B_E4P4zlaWvAbzwhBDa7xGb6w0xQjR3Gw2CRH9hGQnc_8rm6SrkyNhz05IkC8 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:00:59.219371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b55a828bec5e46079d85da062846e17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b55a828bec5e46079d85da062846e17e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b55a828bec5e46079d85da062846e17e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: b55a828bec5e46079d85da062846e17e May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055539109 May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: f789eaddc18244e0a1f8246e6eb21991 May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeTestJSON-1055539109-project May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.221027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '26fef620-abd7-40d5-a072-6af7a0a22ad0'} May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:59.221932 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. May 13 14:00:59.223418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:00:59.224719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] Returning 404 to user: Instance 26fef620-abd7-40d5-a072-6af7a0a22ad0 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:59.224719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ab0c8ab7-10ec-4b13-88df-3112c758c215 tempest-AttachVolumeTestJSON-1055539109 tempest-AttachVolumeTestJSON-1055539109-project] 10.222.0.24 "GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0" status: 404 len: 111 microversion: 2.1 time: 0.030571 May 13 14:00:59.224719 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 573/1158] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:59 2022] GET /compute/v2.1/servers/26fef620-abd7-40d5-a072-6af7a0a22ad0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:59.667986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:59.668614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:59.675218 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.675675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.676455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:59.676897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:59.890472 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:59.898278 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2ca8bcba-e3fe-4003-b988-0218d36fed1f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.234167 May 13 14:00:59.898837 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 586/1159] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:00:59 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:00.235475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-dafec24a-1017-45d3-8011-7433c2a00d28 req-f5679771-b589-4e45-948a-d0d14e055d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b1c277-1049-4450-b506-96dff869d8dc", "name": "network-vif-plugged", "status": "completed", "tag": "4352eab2-ad01-4078-b24d-75fa21a8db75"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:00.245458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-dafec24a-1017-45d3-8011-7433c2a00d28 req-f5679771-b589-4e45-948a-d0d14e055d89 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:00.245899 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-dafec24a-1017-45d3-8011-7433c2a00d28 req-f5679771-b589-4e45-948a-d0d14e055d89 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:00.259355 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-dafec24a-1017-45d3-8011-7433c2a00d28 req-f5679771-b589-4e45-948a-d0d14e055d89 service nova] Creating event network-vif-plugged:4352eab2-ad01-4078-b24d-75fa21a8db75 for instance 93b1c277-1049-4450-b506-96dff869d8dc on hv-cinder-79578 May 13 14:01:00.264573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-dafec24a-1017-45d3-8011-7433c2a00d28 req-f5679771-b589-4e45-948a-d0d14e055d89 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 May 13 14:01:00.265178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 574/1160] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:00.915937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:00.916555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:00.923256 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:00.923707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:00.924465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:00.924897 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:01.136940 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:01.145380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9a11ee38-d3b3-45fa-9a99-b1ba2eb50ec1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.233466 May 13 14:01:01.145949 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 587/1161] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:01:00 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:02.164563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:02.165263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:02.172277 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:02.172635 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:02.173406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:02.173846 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:02.313646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:02.322950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b7054bee-cc5f-4077-9822-1266e0ea7b27 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1367 microversion: 2.1 time: 0.163183 May 13 14:01:02.323972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 575/1162] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:01:02 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:03.342395 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:03.343136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:03.350246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:03.350834 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:03.351683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:03.352203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:03.486719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:03.494645 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6b969946-d90b-4799-a113-784788f0b2f4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1558 microversion: 2.1 time: 0.158762 May 13 14:01:03.495207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 588/1163] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:01:03 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:03.511388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:03.511955 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:03.518382 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:03.519050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:03.520380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:03.520380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:03.598893 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1d6cb85a-53e3-4252-ad1d-9d88b6a21ea3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091294 May 13 14:01:03.599600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 576/1164] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 14:01:03 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:03.992672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7b7013e7-53fc-4f80-9b62-3ffcd363586c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Action: 'create', calling method: .version_select at 0x7ff1591019d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1117996261"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:04.290186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7b7013e7-53fc-4f80-9b62-3ffcd363586c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.418768 May 13 14:01:04.291131 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 589/1165] 10.222.0.24 () {60 vars in 1154 bytes} [Fri May 13 14:01:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 14:01:04.301866 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-99ae5843-edd6-4ca9-8dea-1ac6d55c85fd tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff147e99c10>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:04.350035 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-99ae5843-edd6-4ca9-8dea-1ac6d55c85fd tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 200 len: 345 microversion: 2.1 time: 0.051830 May 13 14:01:04.350833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 577/1166] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:04 2022] GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:04.921908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-1d45fed6-9ec3-4100-a789-65c222242dad req-6f55d352-bd3a-4713-8ce3-b06516614aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b1c277-1049-4450-b506-96dff869d8dc", "tag": "4352eab2-ad01-4078-b24d-75fa21a8db75"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:04.930820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1d45fed6-9ec3-4100-a789-65c222242dad req-6f55d352-bd3a-4713-8ce3-b06516614aec service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.931285 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-1d45fed6-9ec3-4100-a789-65c222242dad req-6f55d352-bd3a-4713-8ce3-b06516614aec service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.941520 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-1d45fed6-9ec3-4100-a789-65c222242dad req-6f55d352-bd3a-4713-8ce3-b06516614aec service nova] Creating event network-changed:4352eab2-ad01-4078-b24d-75fa21a8db75 for instance 93b1c277-1049-4450-b506-96dff869d8dc on hv-cinder-79578 May 13 14:01:04.947146 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-1d45fed6-9ec3-4100-a789-65c222242dad req-6f55d352-bd3a-4713-8ce3-b06516614aec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083072 May 13 14:01:04.947894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 590/1167] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:05.363809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-678bee4e-a244-40ab-bdac-7b98fd81a5ac tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541f4ee0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:05.411032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-678bee4e-a244-40ab-bdac-7b98fd81a5ac tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 200 len: 346 microversion: 2.1 time: 0.051740 May 13 14:01:05.411653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 578/1168] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:05 2022] GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:05.423504 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-e148e8d5-5519-46ea-8f67-fddb76b082a6 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Action: 'create', calling method: .version_select at 0x7ff1541c1820>, body: {"snapshot": {"volume_id": "f970e5fd-9f1d-47a3-bb43-a3c2e2096397", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1697830671"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:05.584588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-e148e8d5-5519-46ea-8f67-fddb76b082a6 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.165405 May 13 14:01:05.585847 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 591/1169] 10.222.0.24 () {60 vars in 1161 bytes} [Fri May 13 14:01:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:05.595621 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f109101e-945d-4efc-a544-96568ba9c2b8 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541f4790>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:05.629694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f109101e-945d-4efc-a544-96568ba9c2b8 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.037944 May 13 14:01:05.630498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 579/1170] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:05 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:05.641300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8720f5ce-235e-4972-bf62-f2e776e6985a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff159101d30>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:05.671670 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8720f5ce-235e-4972-bf62-f2e776e6985a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034410 May 13 14:01:05.672444 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 592/1171] 10.222.0.24 () {58 vars in 1139 bytes} [Fri May 13 14:01:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:05.683240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d3847489-dffb-4f55-bc97-f4e177b5b026 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1540a20d0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:05.714541 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d3847489-dffb-4f55-bc97-f4e177b5b026 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.035148 May 13 14:01:05.715119 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 580/1172] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:05 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:06.732430 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ce3ebaaf-1527-43f8-8a0c-145a46044e0a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff15913e040>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:06.765895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ce3ebaaf-1527-43f8-8a0c-145a46044e0a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.041772 May 13 14:01:06.766491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 593/1173] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:06 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:07.780834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d290c8da-fc33-4230-8fa2-fdf67bcb6fd6 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541f4160>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:07.812023 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d290c8da-fc33-4230-8fa2-fdf67bcb6fd6 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.036940 May 13 14:01:07.812601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 581/1174] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:07 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:08.828742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d07aff91-d1ed-4855-8d71-15a065115eb1 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff154237b80>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:08.866890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d07aff91-d1ed-4855-8d71-15a065115eb1 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.045220 May 13 14:01:08.867455 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 594/1175] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:08 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:09.883222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8114803d-ae70-463d-a57d-7ce2bf59c5f8 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541bc9d0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:09.922788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8114803d-ae70-463d-a57d-7ce2bf59c5f8 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.046499 May 13 14:01:09.923448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 582/1176] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:09 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:10.940988 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-957f6401-cf2e-4fc9-ae54-2c453dba6fc3 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff15421d3a0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:10.971156 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-957f6401-cf2e-4fc9-ae54-2c453dba6fc3 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 288 microversion: 2.1 time: 0.037560 May 13 14:01:10.971719 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 595/1177] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:10 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:10.982823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8cc27696-2c74-409f-8341-1d0001dba14f tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541f8c10>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:11.050880 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8cc27696-2c74-409f-8341-1d0001dba14f tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 202 len: 0 microversion: 2.1 time: 0.072147 May 13 14:01:11.051571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 583/1178] 10.222.0.24 () {58 vars in 1253 bytes} [Fri May 13 14:01:10 2022] DELETE /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:01:11.062836 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-675c06f3-df64-4217-9c58-ba6263e5d39b tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541c1790>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:11.095383 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-675c06f3-df64-4217-9c58-ba6263e5d39b tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 200 len: 287 microversion: 2.1 time: 0.038730 May 13 14:01:11.095937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 596/1179] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:11 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:12.114160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e27f822-a120-4b96-85c2-81391c2e76ba tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541bca60>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:12.142345 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-6e27f822-a120-4b96-85c2-81391c2e76ba tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] HTTP exception thrown: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e27f822-a120-4b96-85c2-81391c2e76ba tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Request method failure captured: May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e HTTP/1.1 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmSfmTbqrvxRZq8C9RU5u9zoDHkdfyLWMgBK7i5sSDlkVKj5Nv2Iyh4D1wCn2saM4ttaSY8TvKtEyEqTkxKFRevWmUB67DM9GuuurO6eo_ivaLAZsT5vB0gOYIcBZfaP10hTKRM56qIK5lOOPDPmSDsAddwzZfi9t5OLR6DB3buCxwc May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:12.146088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0777393d5da3406896bf984f2d8abd71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 2080f37af3954beca014570b47d0e58d May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '4b4a07ea-e802-4a42-9159-372bf9ae8e6e'} May 13 14:01:12.147861 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. (HTTP 404) (Request-ID: req-a3e6d392-5dcf-4723-ad1c-5f3acffb22cb) May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.149104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:12.150391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 14:01:12.151778 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e27f822-a120-4b96-85c2-81391c2e76ba tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Returning 404 to user: Snapshot 4b4a07ea-e802-4a42-9159-372bf9ae8e6e could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:12.153662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6e27f822-a120-4b96-85c2-81391c2e76ba tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e" status: 404 len: 111 microversion: 2.1 time: 0.042355 May 13 14:01:12.154685 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 584/1180] 10.222.0.24 () {58 vars in 1250 bytes} [Fri May 13 14:01:12 2022] GET /compute/v2.1/os-snapshots/4b4a07ea-e802-4a42-9159-372bf9ae8e6e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:12.158604 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cdf83ae2-832b-4f72-9332-e5a00db9734f tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff154d64dc0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:12.231567 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cdf83ae2-832b-4f72-9332-e5a00db9734f tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 202 len: 0 microversion: 2.1 time: 0.078732 May 13 14:01:12.232283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 597/1181] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:01:12 2022] DELETE /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:01:12.240653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4056ffcb-ea37-4894-8393-cec2a37f0a5a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1543b38b0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:12.288418 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4056ffcb-ea37-4894-8393-cec2a37f0a5a tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 200 len: 345 microversion: 2.1 time: 0.051601 May 13 14:01:12.289048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 585/1182] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:12 2022] GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:13.302283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-920a913b-fa2c-4c9b-926e-27e062a0eedb tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1541c1c10>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:13.333876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-920a913b-fa2c-4c9b-926e-27e062a0eedb tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] HTTP exception thrown: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-920a913b-fa2c-4c9b-926e-27e062a0eedb tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Request method failure captured: May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 HTTP/1.1 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmSfmTbqrvxRZq8C9RU5u9zoDHkdfyLWMgBK7i5sSDlkVKj5Nv2Iyh4D1wCn2saM4ttaSY8TvKtEyEqTkxKFRevWmUB67DM9GuuurO6eo_ivaLAZsT5vB0gOYIcBZfaP10hTKRM56qIK5lOOPDPmSDsAddwzZfi9t5OLR6DB3buCxwc May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:13.340063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0777393d5da3406896bf984f2d8abd71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 2080f37af3954beca014570b47d0e58d May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'f970e5fd-9f1d-47a3-bb43-a3c2e2096397'} May 13 14:01:13.341627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. (HTTP 404) (Request-ID: req-a739aa72-7ce9-4b21-bbb5-b1497b0f9a2a) May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.342587 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:13.343867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:01:13.345111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-920a913b-fa2c-4c9b-926e-27e062a0eedb tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Returning 404 to user: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-920a913b-fa2c-4c9b-926e-27e062a0eedb tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 404 len: 109 microversion: 2.1 time: 0.044038 May 13 14:01:13.346607 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 598/1183] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:13 2022] GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:13.353054 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2b69edd0-1dd0-49e7-aa64-49f6fa1dfd8c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff1540443a0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:13.380402 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-2b69edd0-1dd0-49e7-aa64-49f6fa1dfd8c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] HTTP exception thrown: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2b69edd0-1dd0-49e7-aa64-49f6fa1dfd8c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Request method failure captured: May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 HTTP/1.1 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmSfmTbqrvxRZq8C9RU5u9zoDHkdfyLWMgBK7i5sSDlkVKj5Nv2Iyh4D1wCn2saM4ttaSY8TvKtEyEqTkxKFRevWmUB67DM9GuuurO6eo_ivaLAZsT5vB0gOYIcBZfaP10hTKRM56qIK5lOOPDPmSDsAddwzZfi9t5OLR6DB3buCxwc May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:13.383220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0777393d5da3406896bf984f2d8abd71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 2080f37af3954beca014570b47d0e58d May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'f970e5fd-9f1d-47a3-bb43-a3c2e2096397'} May 13 14:01:13.384775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. (HTTP 404) (Request-ID: req-fc3c7733-1757-459d-8a72-9837a2f159ec) May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.385665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:13.386961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 14:01:13.388523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2b69edd0-1dd0-49e7-aa64-49f6fa1dfd8c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Returning 404 to user: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:13.389936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2b69edd0-1dd0-49e7-aa64-49f6fa1dfd8c tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 404 len: 109 microversion: 2.1 time: 0.036139 May 13 14:01:13.390950 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 586/1184] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:01:13 2022] DELETE /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:13.394357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-845e4f22-1027-482c-8403-37649306e054 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Calling method '.version_select at 0x7ff15418a550>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:13.423125 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-845e4f22-1027-482c-8403-37649306e054 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] HTTP exception thrown: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-845e4f22-1027-482c-8403-37649306e054 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Request method failure captured: May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 HTTP/1.1 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmSfmTbqrvxRZq8C9RU5u9zoDHkdfyLWMgBK7i5sSDlkVKj5Nv2Iyh4D1wCn2saM4ttaSY8TvKtEyEqTkxKFRevWmUB67DM9GuuurO6eo_ivaLAZsT5vB0gOYIcBZfaP10hTKRM56qIK5lOOPDPmSDsAddwzZfi9t5OLR6DB3buCxwc May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:13.425029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0777393d5da3406896bf984f2d8abd71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0777393d5da3406896bf984f2d8abd71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 0777393d5da3406896bf984f2d8abd71 May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2092438205 May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 2080f37af3954beca014570b47d0e58d May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2092438205-project May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'f970e5fd-9f1d-47a3-bb43-a3c2e2096397'} May 13 14:01:13.426623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. (HTTP 404) (Request-ID: req-898f8cf1-d79d-48be-9231-a1b4d945688d) May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.427551 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:13.429025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:01:13.430874 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-845e4f22-1027-482c-8403-37649306e054 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] Returning 404 to user: Volume f970e5fd-9f1d-47a3-bb43-a3c2e2096397 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-845e4f22-1027-482c-8403-37649306e054 tempest-VolumesSnapshotsTestJSON-2092438205 tempest-VolumesSnapshotsTestJSON-2092438205-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397" status: 404 len: 109 microversion: 2.1 time: 0.037112 May 13 14:01:13.432257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 599/1185] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:13 2022] GET /compute/v2.1/os-volumes/f970e5fd-9f1d-47a3-bb43-a3c2e2096397 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:16.240613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b8bb264c-3bf8-4770-8fe7-2c71feaaafe1 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff154087d30>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:16.291618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b8bb264c-3bf8-4770-8fe7-2c71feaaafe1 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1eeb281c-85eb-4f8f-91a3-5ddb4c8dd606" status: 200 len: 350 microversion: 2.1 time: 0.055136 May 13 14:01:16.292361 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 587/1186] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:16 2022] GET /compute/v2.1/os-volumes/1eeb281c-85eb-4f8f-91a3-5ddb4c8dd606 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:17.629404 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0c975302-9a53-4f38-b8d8-c9a368c1250f tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff154172310>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:17.680360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0c975302-9a53-4f38-b8d8-c9a368c1250f tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/24558155-5e23-420b-ac05-0bd1de35410b" status: 200 len: 350 microversion: 2.1 time: 0.055928 May 13 14:01:17.680936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 600/1187] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:17 2022] GET /compute/v2.1/os-volumes/24558155-5e23-420b-ac05-0bd1de35410b => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:19.021946 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-78cf1ac2-101d-46d3-8567-302799cbc85b tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1541a0e50>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.072406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-78cf1ac2-101d-46d3-8567-302799cbc85b tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/a0453306-0b44-488a-ac47-8d6d5e744b87" status: 200 len: 350 microversion: 2.1 time: 0.054842 May 13 14:01:19.072971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 588/1188] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes/a0453306-0b44-488a-ac47-8d6d5e744b87 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:19.086338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-4efdcb79-a70c-49cd-87a1-b82ab530a799 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1590925e0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.169336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-4efdcb79-a70c-49cd-87a1-b82ab530a799 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087331 May 13 14:01:19.169891 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 601/1189] 10.222.0.24 () {58 vars in 1133 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:19.182559 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4a5bc4ab-e05b-4334-82b6-6fce83c0a3e6 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1541a0820>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.265066 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4a5bc4ab-e05b-4334-82b6-6fce83c0a3e6 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086617 May 13 14:01:19.265669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 589/1190] 10.222.0.24 () {58 vars in 1148 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:19.278469 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0dc69917-7e62-45e6-98e4-b999c2949ca7 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1590ef430>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.360763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0dc69917-7e62-45e6-98e4-b999c2949ca7 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086950 May 13 14:01:19.361337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 602/1191] 10.222.0.24 () {58 vars in 1133 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:19.372810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1ba4d75a-03eb-4ba8-9773-402b8e8649ca tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1543b31f0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.454831 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1ba4d75a-03eb-4ba8-9773-402b8e8649ca tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085736 May 13 14:01:19.455414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 590/1192] 10.222.0.24 () {58 vars in 1166 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:19.473667 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a6d99cfb-a87d-4199-9b69-392d8515aacb tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff159092af0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.561517 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a6d99cfb-a87d-4199-9b69-392d8515aacb tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093620 May 13 14:01:19.562442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 603/1193] 10.222.0.24 () {58 vars in 1169 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:19.580207 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cf89999c-5aaf-48de-be1a-959fc9b13878 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff154393a60>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.664723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cf89999c-5aaf-48de-be1a-959fc9b13878 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.090479 May 13 14:01:19.665283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 591/1194] 10.222.0.24 () {58 vars in 1154 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:19.676552 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bfdd86be-ec27-4d9d-a7e1-7365da948b5e tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff15418a3a0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.757374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bfdd86be-ec27-4d9d-a7e1-7365da948b5e tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084505 May 13 14:01:19.757945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 604/1195] 10.222.0.24 () {58 vars in 1187 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:19.772141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ea8c4fba-2121-47bf-91bf-0eb314713986 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] Calling method '.version_select at 0x7ff1542e5a60>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.874396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ea8c4fba-2121-47bf-91bf-0eb314713986 tempest-VolumesTestJSON-1996653019 tempest-VolumesTestJSON-1996653019-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.107918 May 13 14:01:19.875317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 592/1196] 10.222.0.24 () {58 vars in 1154 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:24.815812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a937f803-1805-4c93-ba7a-df3b8f3299de tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Action: 'create', calling method: .version_select at 0x7ff1590efc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2032991832", "metadata": {"Type": "work"}}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a937f803-1805-4c93-ba7a-df3b8f3299de tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 122 May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:24.832773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2032991832", "metadata": {"Type": "work"}}} May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:01:24.834363 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2032991832', 'metadata': {'Type': 'work'}}}} May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise error May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi '#$%' May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:24.835336 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 14:01:24.836993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 14:01:24.838479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 14:01:24.838479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.838479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a937f803-1805-4c93-ba7a-df3b8f3299de tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:24.838479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a937f803-1805-4c93-ba7a-df3b8f3299de tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135588 May 13 14:01:24.838479 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 605/1197] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 13 14:01:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:24.844985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a0a163be-ccef-43ea-9bfd-cc0fd6aed195 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Action: 'create', calling method: .version_select at 0x7ff147f74040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-671204675", "metadata": {"Type": "work"}}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a0a163be-ccef-43ea-9bfd-cc0fd6aed195 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 119 May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:24.848153 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-671204675", "metadata": {"Type": "work"}}} May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: May 13 14:01:24.849600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-671204675', 'metadata': {'Type': 'work'}}}} May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise error May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi '0' May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:24.850700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 14:01:24.852354 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 14:01:24.853805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 14:01:24.853805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.853805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a0a163be-ccef-43ea-9bfd-cc0fd6aed195 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:24.853805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a0a163be-ccef-43ea-9bfd-cc0fd6aed195 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009029 May 13 14:01:24.853805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 593/1198] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 13 14:01:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 14:01:24.859264 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-057e6a72-10d2-44ac-9d66-e6e878fd947a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Action: 'create', calling method: .version_select at 0x7ff15418a4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-893582998", "metadata": {"Type": "work"}}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-057e6a72-10d2-44ac-9d66-e6e878fd947a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 118 May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:24.861582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-893582998", "metadata": {"Type": "work"}}} May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:01:24.863121 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-893582998', 'metadata': {'Type': 'work'}}}} May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise error May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi '' May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:24.864263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 14:01:24.865921 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 14:01:24.867594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 14:01:24.867594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.867594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-057e6a72-10d2-44ac-9d66-e6e878fd947a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:24.867594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-057e6a72-10d2-44ac-9d66-e6e878fd947a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007631 May 13 14:01:24.867594 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 606/1199] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 13 14:01:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:24.872939 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a3b5324e-7a45-4063-8a6b-8666272e0585 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Calling method '.version_select at 0x7ff154393ca0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:24.899928 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-a3b5324e-7a45-4063-8a6b-8666272e0585 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] HTTP exception thrown: Volume tempest-invalid-1529144979 could not be found. May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a3b5324e-7a45-4063-8a6b-8666272e0585 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1529144979 HTTP/1.1 May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:24.902176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Volume tempest-invalid-1529144979 could not be found. May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'tempest-invalid-1529144979'} May 13 14:01:24.904112 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1529144979 could not be found. (HTTP 404) (Request-ID: req-6277577a-a7d5-49c4-911a-b412a851f317) May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.905089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:24.906529 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1529144979 could not be found. May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:24.907777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1529144979 could not be found. May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1529144979 could not be found. May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a3b5324e-7a45-4063-8a6b-8666272e0585 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 404 to user: Volume tempest-invalid-1529144979 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a3b5324e-7a45-4063-8a6b-8666272e0585 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1529144979" status: 404 len: 99 microversion: 2.1 time: 0.035273 May 13 14:01:24.909040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 594/1200] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 14:01:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1529144979 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 14:01:24.913271 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f67e5c50-4f65-4608-827a-f21a50178ecb tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003729 May 13 14:01:24.913762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 607/1201] 10.222.0.24 () {58 vars in 1139 bytes} [Fri May 13 14:01:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 13 14:01:24.922004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b15efb47-d94f-4444-8921-f9b86ba3642a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003609 May 13 14:01:24.922517 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 595/1202] 10.222.0.24 () {58 vars in 1136 bytes} [Fri May 13 14:01:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 13 14:01:24.931488 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9827ea0d-a875-4463-807e-32ba03d93c5a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Calling method '.version_select at 0x7ff159092c10>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:24.958288 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-9827ea0d-a875-4463-807e-32ba03d93c5a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] HTTP exception thrown: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9827ea0d-a875-4463-807e-32ba03d93c5a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/os-volumes/55736bfb-021e-4930-a0a9-7e2f851d73b6 HTTP/1.1 May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:24.960282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '55736bfb-021e-4930-a0a9-7e2f851d73b6'} May 13 14:01:24.962126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. (HTTP 404) (Request-ID: req-f686b10d-a5fd-4de8-b741-81d79527aa09) May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.963338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:01:24.964962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 14:01:24.966530 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9827ea0d-a875-4463-807e-32ba03d93c5a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 404 to user: Volume 55736bfb-021e-4930-a0a9-7e2f851d73b6 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9827ea0d-a875-4463-807e-32ba03d93c5a tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/55736bfb-021e-4930-a0a9-7e2f851d73b6" status: 404 len: 109 microversion: 2.1 time: 0.034354 May 13 14:01:24.968047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 608/1203] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:01:24 2022] DELETE /compute/v2.1/os-volumes/55736bfb-021e-4930-a0a9-7e2f851d73b6 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:24.971333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4e660392-eaa1-4bbe-844d-99318faaf259 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Calling method '.version_select at 0x7ff1542e5af0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:24.997790 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-4e660392-eaa1-4bbe-844d-99318faaf259 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] HTTP exception thrown: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4e660392-eaa1-4bbe-844d-99318faaf259 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Request method failure captured: May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/os-volumes/3a032d61-dddd-41ce-8111-d5baaf21a98b HTTP/1.1 May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmS0ed93VQW2c2I6_ZSawBZrUUd3wBxN00_tNGn8o1ZwH_q190YhHhpGSz7GV5igNTF9MPtlgzD9h6pAPnu3BJn7DcPKda8akDAO_ulYo-sAABe4su4l8EZlK0iPNFVFAWSF7dOGeXJfSaajDwdYUKUt8a7cECdsUBBHlPh4Ioo3fbU May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:25.000260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/908d49c02e594bdebd1f5e21eb0081fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-VolumesNegativeTest-1246764144 May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 908d49c02e594bdebd1f5e21eb0081fc May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-VolumesNegativeTest-1246764144 May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 78344288e35849489238834923ac0500 May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-VolumesNegativeTest-1246764144-project May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '3a032d61-dddd-41ce-8111-d5baaf21a98b'} May 13 14:01:25.002335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. (HTTP 404) (Request-ID: req-a8c290ef-8d31-4ac2-90a8-e68796e12054) May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:25.003378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:01:25.004868 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:01:25.006285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4e660392-eaa1-4bbe-844d-99318faaf259 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] Returning 404 to user: Volume 3a032d61-dddd-41ce-8111-d5baaf21a98b could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:25.007678 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4e660392-eaa1-4bbe-844d-99318faaf259 tempest-VolumesNegativeTest-1246764144 tempest-VolumesNegativeTest-1246764144-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3a032d61-dddd-41ce-8111-d5baaf21a98b" status: 404 len: 109 microversion: 2.1 time: 0.034286 May 13 14:01:25.008766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 596/1204] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:01:24 2022] GET /compute/v2.1/os-volumes/3a032d61-dddd-41ce-8111-d5baaf21a98b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:01:46.896912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:46.897950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:46.906159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.906610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.907379 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.907788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.937440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-156d27fe-7115-4e9d-a194-78a348da9801 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045495 May 13 14:01:46.937970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 609/1205] 10.222.0.24 () {60 vars in 1342 bytes} [Fri May 13 14:01:46 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:46.999430 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:46.999982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:47.008329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.008781 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.009555 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.010005 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.035999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:01:47.125154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2da4a6cc-8423-4018-8b6d-a78325b941d2 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 204 len: 0 microversion: 2.20 time: 0.131854 May 13 14:01:47.125789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 597/1206] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 13 14:01:46 2022] DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 14:01:47.134964 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:47.135582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:47.141886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.142378 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.143148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.143589 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.274772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:47.287951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:47.290361 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:47.292163 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a343e8b8-028f-461b-b2b7-223901a11931 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.160918 May 13 14:01:47.292938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 610/1207] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:47 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:48.315416 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:48.315972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:48.322744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.323188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.323943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.324370 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.475904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:48.484033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:48.485580 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:48.486775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-384146f4-42d8-4c30-a630-787a7976cf22 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.175856 May 13 14:01:48.487366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 598/1208] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:48 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:49.509765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:49.510761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:49.521368 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.521818 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.522628 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.523057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.673861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:49.682168 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:49.683654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:49.684813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d4e1f165-1a01-450a-8a3a-723b48dbf3a9 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.181685 May 13 14:01:49.685385 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 611/1209] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:49 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:50.703723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:50.704428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:50.711466 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.711913 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.712683 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.713110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.908612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:50.920862 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:50.923256 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c45393e3054bc3a1417fc23e721853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a565cd1f4c84527bc91fceaff6c5689', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:50.924990 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3a653ab9-77e1-4389-a898-60d8da240db4 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 200 len: 1724 microversion: 2.20 time: 0.225159 May 13 14:01:50.925833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 599/1210] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:50 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:51.543323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-f0481b99-5874-4c82-b1df-3c330e68896b req-535daf0b-d756-424c-aaf4-cab7fe2cbbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f967688-e7d6-442a-ac8b-1808e31009d0", "name": "network-vif-deleted", "tag": "a41348c8-0e52-4739-9763-c905448482e1"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:51.551205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-f0481b99-5874-4c82-b1df-3c330e68896b req-535daf0b-d756-424c-aaf4-cab7fe2cbbe0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.551689 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-f0481b99-5874-4c82-b1df-3c330e68896b req-535daf0b-d756-424c-aaf4-cab7fe2cbbe0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.563145 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-f0481b99-5874-4c82-b1df-3c330e68896b req-535daf0b-d756-424c-aaf4-cab7fe2cbbe0 service nova] Creating event network-vif-deleted:a41348c8-0e52-4739-9763-c905448482e1 for instance 3f967688-e7d6-442a-ac8b-1808e31009d0 on hv-cinder-79578 May 13 14:01:51.568961 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-f0481b99-5874-4c82-b1df-3c330e68896b req-535daf0b-d756-424c-aaf4-cab7fe2cbbe0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259155 May 13 14:01:51.569528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 612/1211] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:51.947577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:51.948208 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:51.954651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.955127 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.955864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.956290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.969935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 HTTP/1.1 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:51.971638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:51.973496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '3f967688-e7d6-442a-ac8b-1808e31009d0'} May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:51.974640 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:51.976209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:51.977604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:51.977604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6e429163-00c1-4d7c-833b-22192f275e92 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 404 len: 111 microversion: 2.20 time: 0.029590 May 13 14:01:51.977604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 600/1212] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:51 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:51.987057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ff2b9413-51b9-4789-b1e5-a8a5a616716d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '.version_select at 0x7ff15913b8b0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:52.007068 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ff2b9413-51b9-4789-b1e5-a8a5a616716d tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399638959" status: 204 len: 0 microversion: 2.20 time: 0.024119 May 13 14:01:52.007646 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 613/1213] 10.222.0.24 () {60 vars in 1258 bytes} [Fri May 13 14:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399638959 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 14:01:53.805506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:53.806031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:53.812810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.813257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.814010 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.814474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.828281 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 HTTP/1.1 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:53.829857 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.831538 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '3f967688-e7d6-442a-ac8b-1808e31009d0'} May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:53.832636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.834138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:53.835704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:53.835704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3137bf54-c95e-4d27-ac55-790e36db76af tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 404 len: 111 microversion: 2.20 time: 0.029745 May 13 14:01:53.835704 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 601/1214] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 13 14:01:53 2022] DELETE /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:53.841148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:53.841937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 3f967688-e7d6-442a-ac8b-1808e31009d0] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:53.848622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.849072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.849943 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.851031 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.864298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 HTTP/1.1 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:53.866523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.868202 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '3f967688-e7d6-442a-ac8b-1808e31009d0'} May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:53.869112 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. May 13 14:01:53.870609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:53.872075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 3f967688-e7d6-442a-ac8b-1808e31009d0 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:53.872075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6334d698-be84-4a1e-a467-02c12e0760c3 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0" status: 404 len: 111 microversion: 2.20 time: 0.031232 May 13 14:01:53.872075 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 614/1215] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:53 2022] GET /compute/v2.1/servers/3f967688-e7d6-442a-ac8b-1808e31009d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:55.015713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:55.016233 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:55.023144 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:55.023618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:55.024388 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:55.024828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:55.039249 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 HTTP/1.1 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:01:55.040807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.042471 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '37444ba4-a1cb-48d8-adbf-8f58200aba40'} May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:55.043673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.045092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:01:55.046752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:55.046752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b5592fc2-9927-4185-a4ad-7b4853833d01 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 404 len: 111 microversion: 2.20 time: 0.030437 May 13 14:01:55.046752 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 602/1216] 10.222.0.24 () {60 vars in 1279 bytes} [Fri May 13 14:01:55 2022] DELETE /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:55.051861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:55.052470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] [instance: 37444ba4-a1cb-48d8-adbf-8f58200aba40] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:55.059110 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:55.059562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:55.060331 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:55.060766 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:55.074742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] HTTP exception thrown: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Request method failure captured: May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 HTTP/1.1 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmHgeglgAXkcEXmejxtvfAW22d46-B5Ew8ERVZanYf-hZyMSV_edpXl1k01z4mMhNlEgjTXMwQth608vAS_W4lRepkgH5PSYqCzfa0kFOr_npSBg5iquv6hZGlnQVvxuRkX9vfZVlRnMsTzr8t4MbPiLv0cG7lAHriB7QjB0EcqcU_M May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:01:55.076280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1a565cd1f4c84527bc91fceaff6c5689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 1a565cd1f4c84527bc91fceaff6c5689 May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512116090 May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 35c45393e3054bc3a1417fc23e721853 May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512116090-project May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.077890 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '37444ba4-a1cb-48d8-adbf-8f58200aba40'} May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:55.078823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. May 13 14:01:55.080280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:01:55.081703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] Returning 404 to user: Instance 37444ba4-a1cb-48d8-adbf-8f58200aba40 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:55.081703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cab58440-ccaa-40ad-bd4e-ea053b5ef7e7 tempest-AttachVolumeShelveTestJSON-1512116090 tempest-AttachVolumeShelveTestJSON-1512116090-project] 10.222.0.24 "GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40" status: 404 len: 111 microversion: 2.20 time: 0.029910 May 13 14:01:55.081703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 615/1217] 10.222.0.24 () {60 vars in 1276 bytes} [Fri May 13 14:01:55 2022] GET /compute/v2.1/servers/37444ba4-a1cb-48d8-adbf-8f58200aba40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:02:17.925524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-01a892e1-0e83-4436-92e7-160f41d0971e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'create', calling method: .version_select at 0x7ff1541d0f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1688352020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7L/Mwh/zWF3/YPdkTu6vYpgpKUFoPiRZFZUVNq9l5AcCzFXvV7Ur0A5wrS3t45zTfki75II8wyTaZ6sxKpniEBqmtS+kgSkKl9Tsry9URXYBMw6ZXuiPWv0x7KhnZfrA=="}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:17.941232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-01a892e1-0e83-4436-92e7-160f41d0971e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Getting quotas for project 05db243be3a84144ada513f22c0b6076. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:02:17.945984 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-01a892e1-0e83-4436-92e7-160f41d0971e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Getting quotas for user d5a3443f5ce445af93cf7a9107a793ea and project 05db243be3a84144ada513f22c0b6076. Resources: {'key_pairs'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:02:17.973523 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-01a892e1-0e83-4436-92e7-160f41d0971e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052156 May 13 14:02:17.974146 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 603/1218] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 14:02:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:18.028225 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1166638106", "imageRef": "ed16a9a9-4de1-4c04-81d4-452575ad811e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1688352020", "networks": [{"uuid": "ddb49c6a-e97b-4ca6-b132-a498375b90e5"}]}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:18.089788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] validate_networks() for [('ddb49c6a-e97b-4ca6-b132-a498375b90e5', None, None, None, None, None)] {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:02:18.492555 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:02:18.493189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:02:18.493820 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:02:18.494263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:02:18.494672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:02:18.504401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:18.505111 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:18.505958 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:18.506951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:18.523376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Getting quotas for project 05db243be3a84144ada513f22c0b6076. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:02:18.527570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Getting quotas for user d5a3443f5ce445af93cf7a9107a793ea and project 05db243be3a84144ada513f22c0b6076. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:02:18.539327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:02:18.542030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ed16a9a9-4de1-4c04-81d4-452575ad811e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:02:18.591299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-06f6f066-b905-40e7-8c18-f931d67fa31e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567283 May 13 14:02:18.591954 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 616/1219] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 14:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:02:18.603397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a157cc94-45d4-42f4-9e49-bd22b50c6d8a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:18.604262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a157cc94-45d4-42f4-9e49-bd22b50c6d8a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:18.674587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a157cc94-45d4-42f4-9e49-bd22b50c6d8a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:18.683017 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a157cc94-45d4-42f4-9e49-bd22b50c6d8a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1259 microversion: 2.1 time: 0.084268 May 13 14:02:18.683966 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 604/1220] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:18 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1259 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:19.705683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:19.707077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:19.717942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:19.718753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:19.720019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:19.720733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:19.791760 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:19.799249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d1e62ca6-965f-48cd-b297-49f1203820d0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1311 microversion: 2.1 time: 0.101283 May 13 14:02:19.799816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 617/1221] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:19 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:20.818514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:20.820694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:20.830415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:20.830926 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:20.832131 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:20.833389 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:21.004413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:21.012394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2cefde7c-e9c3-487a-af9e-698917b7944e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.199213 May 13 14:02:21.013689 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 605/1222] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:20 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:22.035637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:22.037194 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:22.044813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:22.045523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:22.046377 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:22.046960 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:22.190073 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:22.197873 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-86d3236d-fd1c-4e2a-877e-788f3c40b64a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.168892 May 13 14:02:22.198473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 618/1223] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:22 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:23.215361 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:23.216042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:23.223091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:23.223545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:23.224325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:23.224764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:23.368514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:23.376821 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ce526d4a-7a9e-443e-babb-fe0f7049af55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.165776 May 13 14:02:23.377394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 606/1224] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:23 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:24.392999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:24.393593 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:24.400263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:24.400717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:24.401485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:24.402283 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:24.538204 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:24.546244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3a79e985-09d1-4af1-bc35-09a32e7c611a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.157103 May 13 14:02:24.546813 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 619/1225] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:24 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:25.563969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:25.564619 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:25.572435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:25.572895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:25.573694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:25.574164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:25.711476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:25.719852 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b6a8a4c1-b833-46c3-9ac0-9b62b1593436 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.159837 May 13 14:02:25.720416 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 607/1226] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:25 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:26.737763 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:26.738390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:26.745644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:26.746084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:26.746883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:26.747310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:26.903898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:26.911199 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f9cc3fad-ffe2-41ab-8543-8c3a542c56b5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.177351 May 13 14:02:26.911757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 620/1227] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:26 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:27.930456 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:27.931057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:27.938381 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.938834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.939618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.940051 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:28.077246 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:28.084765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b1df6ac0-0ac6-4dee-9102-654f50efc910 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.158692 May 13 14:02:28.085330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 608/1228] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:27 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:29.102979 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:29.103573 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:29.111271 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.111729 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.112523 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.113021 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.254610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:29.263000 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dd68b932-6696-4f5e-80f3-32f912b8aa5d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.163939 May 13 14:02:29.263586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 621/1229] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:29 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:30.284714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:30.285655 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:30.295205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:30.295657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:30.296416 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:30.296847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:30.440265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:30.448401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8812673c-1495-47ca-9ebc-ff5e835c346c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.170151 May 13 14:02:30.449183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 609/1230] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:30 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:31.470246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:31.471233 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:31.481920 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.482742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.484102 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.484779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.625197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:31.637581 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-467a5e08-de15-4f61-824c-63edb280be00 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.173849 May 13 14:02:31.638186 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 622/1231] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:31 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:32.655625 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:32.656229 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:32.663047 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.663498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.664285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.664720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.806329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:32.813988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-dcfed37f-fdfb-4cab-bea4-d9c5ca0414b4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.163023 May 13 14:02:32.814643 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 610/1232] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:32 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:33.835315 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:33.836304 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:33.847465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.848203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.849599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.850386 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.984265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:33.995366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-afc49006-76b9-4003-b36d-a2374f5362c2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.166367 May 13 14:02:33.996050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 623/1233] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:33 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:35.023122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:35.023975 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:35.032330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:35.032792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:35.033565 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:35.033999 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:35.165687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:35.173573 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-de4f3023-76c9-4efc-8dbb-510f7ee00e2d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.157004 May 13 14:02:35.174170 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 611/1234] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:35 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:36.191248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:36.191805 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:36.198625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.199077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.199884 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.200629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.340266 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:36.348877 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-796f4a32-c7ba-4180-bce3-4b6fb74e5a22 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.161685 May 13 14:02:36.349485 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 624/1235] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:36 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:37.368709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.369654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:37.379209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.379862 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.381016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.381659 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.531341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:37.540212 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-73d06eb5-6af1-446e-a18b-75ebf21978dc tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.177386 May 13 14:02:37.547092 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 612/1236] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:37 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:38.560795 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:38.561442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:38.571162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.571794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:38.572961 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.573566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:38.708287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:38.716046 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-22541bd2-229d-4f89-a244-d1269f842186 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.161602 May 13 14:02:38.716611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 625/1237] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:38 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:39.733122 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:39.733953 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:39.740665 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:39.741115 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.741894 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:39.742364 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.909188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:39.917506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9e67e5de-7598-424c-b536-476b5b169532 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.188359 May 13 14:02:39.918363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 613/1238] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:39 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:40.516675 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-a52137f4-28a2-4198-803d-71b0311997d4 req-db6d97fd-2e2b-4d6a-b5f2-de12040c1e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:40.526332 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a52137f4-28a2-4198-803d-71b0311997d4 req-db6d97fd-2e2b-4d6a-b5f2-de12040c1e4e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.527417 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-a52137f4-28a2-4198-803d-71b0311997d4 req-db6d97fd-2e2b-4d6a-b5f2-de12040c1e4e service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.540835 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-a52137f4-28a2-4198-803d-71b0311997d4 req-db6d97fd-2e2b-4d6a-b5f2-de12040c1e4e service nova] Creating event network-changed:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:02:40.546030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-a52137f4-28a2-4198-803d-71b0311997d4 req-db6d97fd-2e2b-4d6a-b5f2-de12040c1e4e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 May 13 14:02:40.547255 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 626/1239] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:40.934916 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.935501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.942483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.942924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.943700 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.944128 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.156007 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:41.163887 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bc62bad6-036f-46c4-a76b-22e8bf094493 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.232863 May 13 14:02:41.164543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 614/1240] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:40 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:42.182722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:42.183428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:42.190557 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.191002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.191807 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.192244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.328165 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.336592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-39c58e6d-bcb4-4852-8aee-078db9658507 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.158819 May 13 14:02:42.337153 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 627/1241] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:42 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:43.357688 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:43.359286 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:43.369798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.370628 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.371920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.372651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.517188 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:43.524713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-0feff329-dad2-4d2f-9458-888ac77f7811 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.173748 May 13 14:02:43.525289 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 615/1242] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:43 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:44.546685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:44.547308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:44.555855 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:44.556296 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:44.557486 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:44.557976 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:44.706633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:44.714334 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dbb54783-28ca-4cd4-808d-e908a7842751 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.174054 May 13 14:02:44.714895 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 628/1243] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:44 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:45.732814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.733521 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.740539 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.740992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.741766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.742232 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.875313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.883204 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c7a6b3d2-9e10-48f0-b1ca-79311ffec346 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.154550 May 13 14:02:45.883755 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 616/1244] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:45 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:46.907024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:46.908275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:46.915584 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.916076 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:46.916926 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.917397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.051881 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.059299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-46968ade-1610-441a-87cf-7b211d470ea0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.159340 May 13 14:02:47.059868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 629/1245] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:46 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:48.080870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:48.081495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:48.089351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.089850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.090764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.091210 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.226530 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:48.238202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-40af3d7f-f6d2-4474-8e06-12b579d8f6ed tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.164610 May 13 14:02:48.238791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 617/1246] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:48 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:49.255428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:49.256085 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:49.262677 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.263125 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.263889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.264323 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.394381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:49.404375 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-80cf8ea0-dd66-497d-84ff-b2aeb257c37c tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.151851 May 13 14:02:49.405257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 630/1247] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:49 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:50.422971 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:50.423570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:50.430717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:50.431174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:50.432094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:50.432521 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:50.564348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.572265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-65ed3b2c-70f2-45e4-812d-b599aa22d343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.153691 May 13 14:02:50.572838 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 618/1248] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:50 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:51.197675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:02:51.198008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:02:51.589609 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.590332 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.597228 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.597682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.598493 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.598918 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.748330 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:51.756502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cac59714-b4e0-4989-be08-00da062c8012 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.171197 May 13 14:02:51.767087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 631/1249] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:52.774878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:52.775460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:52.782845 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.783326 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.784106 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.784540 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.921165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:52.929029 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-178cef64-44c1-4ba4-89b1-2d21fed03c55 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.158087 May 13 14:02:52.929614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 619/1250] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:52 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:53.466800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-355d84f8-04e6-4273-b054-7223ac782d40 req-9cb23bf6-7be7-4aa0-adfd-7fc4bce0bc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "name": "network-vif-plugged", "status": "completed", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:53.475578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-355d84f8-04e6-4273-b054-7223ac782d40 req-9cb23bf6-7be7-4aa0-adfd-7fc4bce0bc1a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.476018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-355d84f8-04e6-4273-b054-7223ac782d40 req-9cb23bf6-7be7-4aa0-adfd-7fc4bce0bc1a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.487737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-355d84f8-04e6-4273-b054-7223ac782d40 req-9cb23bf6-7be7-4aa0-adfd-7fc4bce0bc1a service nova] Creating event network-vif-plugged:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:02:53.492789 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-355d84f8-04e6-4273-b054-7223ac782d40 req-9cb23bf6-7be7-4aa0-adfd-7fc4bce0bc1a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 May 13 14:02:53.493426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 632/1251] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:53.950108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:53.951132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:53.959682 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.960133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.960943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.961387 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:54.094458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:54.105257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-689c8a8a-7be3-4772-9bb2-12f9f2ae2fa4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.161429 May 13 14:02:54.106223 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 620/1252] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:53 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:55.123752 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:55.124453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:55.131962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:55.132413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:55.133313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:55.133757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:55.275777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:55.284306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ccb437a6-e6ae-42f7-9ffc-5260a5bbb343 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.165310 May 13 14:02:55.284870 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 633/1253] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:55 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:56.305553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:56.306575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:56.317992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.318882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:56.320158 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.320901 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:56.457433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:56.465338 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a3453a88-846d-4fba-88ea-e92e1a5e6093 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.166981 May 13 14:02:56.465877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 621/1254] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:56 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:57.486101 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:57.487401 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:57.497342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.498127 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.499372 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.500084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.637459 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:57.649214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ebf00510-42be-4f4b-8975-a29a199e9938 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.169576 May 13 14:02:57.649986 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 634/1255] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:57 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:58.669805 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:58.670413 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.678439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.678929 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.679725 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.680165 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.826533 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:58.838668 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-09f1c408-7a3d-46df-9fbd-9e79f3f48cc3 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1359 microversion: 2.1 time: 0.174986 May 13 14:02:58.839571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 622/1256] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:58 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:59.859265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:59.859900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:59.869527 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:59.870166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:59.871282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:59.871880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.004654 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.012212 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dbf76637-88bc-41aa-b63a-5bb2398b6ad6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1548 microversion: 2.1 time: 0.157836 May 13 14:03:00.012775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 635/1257] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:02:59 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:00.031823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:00.032485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:00.043123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.043550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.044756 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.045429 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.176133 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.183871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-18565554-4f0e-4eb3-acd5-f76b60cfb1fd tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1548 microversion: 2.1 time: 0.158410 May 13 14:03:00.184447 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 623/1258] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:00 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:00.207905 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:00.211299 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.212060 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Searching by: {'deleted': False, 'project_id': '05db243be3a84144ada513f22c0b6076'} {{(pid=123955) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 14:03:00.219141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.219579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.220762 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.220956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.315007 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.multi_cell_list [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 14:03:00.437513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-669e2df0-870f-458d-89aa-d29b94dd2835 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.234554 May 13 14:03:00.438169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 636/1259] 10.222.0.24 () {58 vars in 1124 bytes} [Fri May 13 14:03:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:00.451094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:00.452016 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:00.462374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.463076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.464116 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.464733 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.607832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.620507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-32016b46-0eae-46ea-98f8-4d9cf093d1b0 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1548 microversion: 2.1 time: 0.175169 May 13 14:03:00.621243 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 624/1260] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:00 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:02.182744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89a8e4d6-54cc-4975-92a6-c366a51a764a"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:02.184188 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:02.192432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.192982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.194408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.194408 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.466195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cac9c465-b239-45bf-8718-6a9079e684b6 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287568 May 13 14:03:02.467151 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 637/1261] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:03:02 2022] POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:13.240434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:13.241020 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:13.247773 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:13.248215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:13.248976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:13.249406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:13.403040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:13.414554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8d89be1e-73ae-48aa-adee-ab6cecd14e37 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1594 microversion: 2.1 time: 0.178430 May 13 14:03:13.415135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 625/1262] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:13 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:15.345981 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-5ae93328-f425-437e-a4ff-57842f8a8eb8 req-78daba39-1c8e-4017-8e81-386dc4ac9d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:15.356248 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-5ae93328-f425-437e-a4ff-57842f8a8eb8 req-78daba39-1c8e-4017-8e81-386dc4ac9d9d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:15.356956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-5ae93328-f425-437e-a4ff-57842f8a8eb8 req-78daba39-1c8e-4017-8e81-386dc4ac9d9d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:15.369419 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-5ae93328-f425-437e-a4ff-57842f8a8eb8 req-78daba39-1c8e-4017-8e81-386dc4ac9d9d service nova] Creating event network-changed:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:03:15.374951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-5ae93328-f425-437e-a4ff-57842f8a8eb8 req-78daba39-1c8e-4017-8e81-386dc4ac9d9d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 May 13 14:03:15.380080 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 638/1263] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:16.667850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1568222008"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:16.668385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:16.675669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.676385 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.677172 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.677856 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.809867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.network.security_group_api [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Adding security group 0a73dff5-1467-4f53-bec8-b090b8621747 to port 8f0987bb-5d95-4977-92b6-5b0bb6fc079a May 13 14:03:17.477467 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-33f26786-e46a-4ff8-806e-6d0f758d1cc2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action" status: 202 len: 0 microversion: 2.1 time: 0.813232 May 13 14:03:17.478705 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 626/1264] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 14:03:16 2022] POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:17.487415 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-593f8c31-0cd2-4794-9aeb-bb3b5fafc6ba req-a0c6065d-6a22-4967-a44a-e76f74994bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:17.489028 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:17.492741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:17.501905 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-593f8c31-0cd2-4794-9aeb-bb3b5fafc6ba req-a0c6065d-6a22-4967-a44a-e76f74994bda service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.502920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-593f8c31-0cd2-4794-9aeb-bb3b5fafc6ba req-a0c6065d-6a22-4967-a44a-e76f74994bda service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.505802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.506074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.507087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.507721 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.530515 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-593f8c31-0cd2-4794-9aeb-bb3b5fafc6ba req-a0c6065d-6a22-4967-a44a-e76f74994bda service nova] Creating event network-changed:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:03:17.537486 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-593f8c31-0cd2-4794-9aeb-bb3b5fafc6ba req-a0c6065d-6a22-4967-a44a-e76f74994bda service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052858 May 13 14:03:17.543609 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 627/1265] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:17.749848 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:17.758801 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-29cb06fd-a2d9-4a07-b96b-7bf6058f5cd2 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1760 microversion: 2.1 time: 0.276177 May 13 14:03:17.760306 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 639/1266] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:17 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1760 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:22.680366 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:22.681096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:22.684715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-99318faf-d128-46bb-b673-a9c8ff39dd11 req-3b65a7f6-3b69-4759-8204-0e8ca32e6734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c1589f-3497-4539-ba14-182a1d5ae653", "tag": "fdf14eda-20ce-4082-84be-e61a4cc52631"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:22.690012 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.699451 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-99318faf-d128-46bb-b673-a9c8ff39dd11 req-3b65a7f6-3b69-4759-8204-0e8ca32e6734 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.700175 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.701132 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.701537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-99318faf-d128-46bb-b673-a9c8ff39dd11 req-3b65a7f6-3b69-4759-8204-0e8ca32e6734 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.701777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.730250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-99318faf-d128-46bb-b673-a9c8ff39dd11 req-3b65a7f6-3b69-4759-8204-0e8ca32e6734 service nova] Creating event network-changed:fdf14eda-20ce-4082-84be-e61a4cc52631 for instance 75c1589f-3497-4539-ba14-182a1d5ae653 on hv-cinder-79578 May 13 14:03:22.741579 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-99318faf-d128-46bb-b673-a9c8ff39dd11 req-3b65a7f6-3b69-4759-8204-0e8ca32e6734 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060930 May 13 14:03:22.742992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 640/1267] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:22.751915 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:22.853948 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-855aea87-f5cd-494e-a852-dbc38609bb3c tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "DELETE /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 204 len: 0 microversion: 2.1 time: 0.177557 May 13 14:03:22.855257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 628/1268] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:22 2022] DELETE /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:03:22.864574 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:22.867078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:22.874825 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.875426 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.876626 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.877154 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.053704 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:23.063604 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-29843161-2353-4c04-a09d-f1cc25a3b275 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1577 microversion: 2.1 time: 0.203598 May 13 14:03:23.064389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 641/1269] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:22 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:24.081902 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:24.087255 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:24.097206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.097760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.099240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.100867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.405221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:24.412873 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-43938e14-0a61-4c40-bfac-bbc383cedc3a tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1577 microversion: 2.1 time: 0.335528 May 13 14:03:24.413638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 629/1270] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:24 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1577 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:25.430132 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:25.430746 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:25.437193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.437648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.438457 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.438936 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.601906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:25.611559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-9b6ca915-3201-4a56-a981-08ca55f6129d tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1577 microversion: 2.1 time: 0.185828 May 13 14:03:25.612441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 642/1271] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:25 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:26.015614 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-33c54e96-a9d1-4096-a026-6c4131221791 req-6566a383-2581-455b-8f91-1e8ce5804055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c1589f-3497-4539-ba14-182a1d5ae653", "name": "network-vif-deleted", "tag": "fdf14eda-20ce-4082-84be-e61a4cc52631"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:26.024648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-33c54e96-a9d1-4096-a026-6c4131221791 req-6566a383-2581-455b-8f91-1e8ce5804055 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.025240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-33c54e96-a9d1-4096-a026-6c4131221791 req-6566a383-2581-455b-8f91-1e8ce5804055 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.037346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-33c54e96-a9d1-4096-a026-6c4131221791 req-6566a383-2581-455b-8f91-1e8ce5804055 service nova] Creating event network-vif-deleted:fdf14eda-20ce-4082-84be-e61a4cc52631 for instance 75c1589f-3497-4539-ba14-182a1d5ae653 on hv-cinder-79578 May 13 14:03:26.043391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-33c54e96-a9d1-4096-a026-6c4131221791 req-6566a383-2581-455b-8f91-1e8ce5804055 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031593 May 13 14:03:26.044135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 630/1272] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:26.629018 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:26.629758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:26.636535 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.637047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.637993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.638637 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.670282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.670644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.671113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lazy-loading 'fault' on Instance uuid 75c1589f-3497-4539-ba14-182a1d5ae653 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:26.718491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:26.726500 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6f5a6db2-a3f3-41b7-86f4-cf4f65b128da tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 200 len: 1229 microversion: 2.1 time: 0.101404 May 13 14:03:26.727088 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 643/1273] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:26 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:27.746230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:27.746901 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 75c1589f-3497-4539-ba14-182a1d5ae653] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:27.754432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.755342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.757022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.757766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.772777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] HTTP exception thrown: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Request method failure captured: May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 HTTP/1.1 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmJusgGc9RN5Z1vrUktnPHSASBacGAkXCu3ysmOX-E7typOT2S3N72_9OeUhR6ome_uufc9kOzBahqe1nhkYM5AjNJMCkhjMJWdRAHmNipRZWKN3gq5qEWazTnqQfDwEJh9V1RdXbisQnMyrI7lAWaNwdTtpVBOg811isE75KN3cm7M May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:03:27.774481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f52886f21f64392889649d64be8b3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestVolumeBootPattern-681955838 May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 1554793dc7934f9889da636263301ecf May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. May 13 14:03:27.776333 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '75c1589f-3497-4539-ba14-182a1d5ae653'} May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:27.777137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. May 13 14:03:27.778519 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:27.779720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Returning 404 to user: Instance 75c1589f-3497-4539-ba14-182a1d5ae653 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:27.779720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c3f867a9-c225-4050-8587-9be82f7467d6 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653" status: 404 len: 111 microversion: 2.1 time: 0.034538 May 13 14:03:27.780959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 631/1274] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:27 2022] GET /compute/v2.1/servers/75c1589f-3497-4539-ba14-182a1d5ae653 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:30.058148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2065340620", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:30.111894 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.network.neutron [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] validate_networks() for None {{(pid=123955) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:03:30.487942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Flavor limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:03:30.488357 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Image limits 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:03:30.488823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Flavor pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:03:30.489219 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Image pref 0:0:0 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:03:30.489622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.virt.hardware [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:03:30.504044 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:30.504702 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:30.505788 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:30.506822 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:30.523933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Getting quotas for project 8380839a09084b5a920567a1c5894518. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:03:30.528453 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Getting quotas for user f22277902a7749358c1029fc505d64e0 and project 8380839a09084b5a920567a1c5894518. Resources: {'ram', 'instances', 'cores'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:03:30.539071 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Going to run 1 instances... {{(pid=123955) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:03:30.541442 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:03:30.588338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-296ccb49-36b1-4e86-9b53-843825ca5315 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533955 May 13 14:03:30.589103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 644/1275] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 14:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:03:30.599662 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-68e7ae49-a98d-484b-8d22-437cb51d5a9b tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:30.601179 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-68e7ae49-a98d-484b-8d22-437cb51d5a9b tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:30.661693 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-68e7ae49-a98d-484b-8d22-437cb51d5a9b tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:30.670445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-68e7ae49-a98d-484b-8d22-437cb51d5a9b tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1215 microversion: 2.1 time: 0.074887 May 13 14:03:30.678270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 632/1276] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:30 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:31.140143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:31.140747 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:31.147663 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.148346 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.149280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.150029 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.153155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-cfafc673-d6df-434b-9090-f4f2e18ae356 req-d450b377-5a92-4513-8d96-b2bb982a0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f0ae3e-2ace-4327-bc72-93aaf6885296", "tag": "a33ac3fe-cf89-428e-8740-85843d8438ac"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:31.163501 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-cfafc673-d6df-434b-9090-f4f2e18ae356 req-d450b377-5a92-4513-8d96-b2bb982a0f51 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.165894 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-cfafc673-d6df-434b-9090-f4f2e18ae356 req-d450b377-5a92-4513-8d96-b2bb982a0f51 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.182079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-cfafc673-d6df-434b-9090-f4f2e18ae356 req-d450b377-5a92-4513-8d96-b2bb982a0f51 service nova] Creating event network-changed:a33ac3fe-cf89-428e-8740-85843d8438ac for instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 on hv-cinder-79578 May 13 14:03:31.188814 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:31.190709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-cfafc673-d6df-434b-9090-f4f2e18ae356 req-d450b377-5a92-4513-8d96-b2bb982a0f51 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041168 May 13 14:03:31.192584 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 633/1277] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:31.278244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1392db76-e304-4c70-add8-5577bdc004ba tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "DELETE /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 204 len: 0 microversion: 2.1 time: 0.142216 May 13 14:03:31.279627 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 645/1278] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:31 2022] DELETE /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:03:31.288742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:31.289448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:31.296173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.296686 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.297524 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.298024 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.430001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:31.437756 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3e8f0a82-30bc-4eef-9ebc-60c7d7ce2fe1 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1577 microversion: 2.1 time: 0.153625 May 13 14:03:31.438346 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 634/1279] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:31 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:31.689094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:31.689707 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:31.702338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.703087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.704025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.704611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.777063 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:31.785277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a1cd2f4e-1a05-4bc0-bac9-2fc2a76595cb tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1267 microversion: 2.1 time: 0.100519 May 13 14:03:31.786438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 646/1280] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:31 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:32.454432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:32.454981 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:32.461723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.462219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.463046 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.463455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.694713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:32.702694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-499df35a-50d6-48c6-b13d-c32be009bcfe tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1577 microversion: 2.1 time: 0.252251 May 13 14:03:32.713265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 635/1281] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:32 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:32.806461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:32.807269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:32.817251 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.817908 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.819370 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.819889 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.931089 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:32.938854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-1c3721fa-20c7-4c6a-bb3e-099e71ed2295 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1273 microversion: 2.1 time: 0.139427 May 13 14:03:32.940053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 647/1282] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:32 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:33.206731 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-012f7de6-3b0d-49d3-975e-8a3fde338abf req-938e4810-0349-4644-982a-de601eb418a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f0ae3e-2ace-4327-bc72-93aaf6885296", "name": "network-vif-deleted", "tag": "a33ac3fe-cf89-428e-8740-85843d8438ac"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:33.215696 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-012f7de6-3b0d-49d3-975e-8a3fde338abf req-938e4810-0349-4644-982a-de601eb418a0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.216214 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-012f7de6-3b0d-49d3-975e-8a3fde338abf req-938e4810-0349-4644-982a-de601eb418a0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.228545 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-012f7de6-3b0d-49d3-975e-8a3fde338abf req-938e4810-0349-4644-982a-de601eb418a0 service nova] Creating event network-vif-deleted:a33ac3fe-cf89-428e-8740-85843d8438ac for instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 on hv-cinder-79578 May 13 14:03:33.233086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-012f7de6-3b0d-49d3-975e-8a3fde338abf req-938e4810-0349-4644-982a-de601eb418a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030118 May 13 14:03:33.234315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 636/1283] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:33.719865 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:33.720491 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:33.726601 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.727249 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.728294 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.729173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.778603 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.779047 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.779683 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lazy-loading 'fault' on Instance uuid 45f0ae3e-2ace-4327-bc72-93aaf6885296 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:33.835800 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554793dc7934f9889da636263301ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f52886f21f64392889649d64be8b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:33.843611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-44dd724a-c27b-4481-a7a0-8af0a1838e01 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 200 len: 1231 microversion: 2.1 time: 0.127629 May 13 14:03:33.844384 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 648/1284] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:33 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 1231 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:33.914859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:33.915536 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:33.922167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.922613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.923384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.923814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.947660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d5d95c0f-e7d1-4aee-8dab-9b15ab84e151 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/ips" status: 200 len: 150 microversion: 2.1 time: 0.215006 May 13 14:03:33.948211 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 637/1285] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:03:33 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/ips => generated 150 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:33.956661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:33.961812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45659754-be72-499a-9345-8aca07469ed1"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:33.963277 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:33.965260 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:33.970151 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.970661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.971432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.972330 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.973440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.975265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:33.977591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:33.978537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.057491 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: POST /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/os-volume_attachments HTTP/1.1 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 74 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:03:34.059606 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {"volumeAttachment": {"volumeId": "45659754-be72-499a-9345-8aca07469ed1"}} May 13 14:03:34.061290 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'server_id': '93b1c277-1049-4450-b506-96dff869d8dc', 'body': {'volumeAttachment': {'volumeId': '45659754-be72-499a-9345-8aca07469ed1'}}} May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.062262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.063793 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:34.065579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:34.065579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:34.065579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:34.065579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 May 13 14:03:34.065579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.066951 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 400 to user: Invalid volume: volume 45659754-be72-499a-9345-8aca07469ed1 is already attached to instances: 62ecf924-4cfd-40a6-8d24-66b488062838 {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:34.068011 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4d681b58-da8c-40ee-82ce-bae7c2ed352e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112478 May 13 14:03:34.069359 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 638/1286] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:03:33 2022] POST /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 14:03:34.086263 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:34.087202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:34.108882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.109660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.110537 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.110969 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.131006 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:34.139011 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-86efb16f-6593-4a1c-b59e-776432b0bea3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.186306 May 13 14:03:34.148930 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 649/1287] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:33 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:34.150430 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:34.238442 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e8fe6b39-8249-4118-8ca7-2a6df65de225 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 204 len: 0 microversion: 2.1 time: 0.164509 May 13 14:03:34.239199 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 639/1288] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:34 2022] DELETE /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:03:34.248061 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:34.248775 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:34.255629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.256166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.257015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.257515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.367019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-0c64d388-76a5-4129-9bb0-174679cce911 req-d46043d6-5f20-4f7f-b7c8-80677605d759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e7e99c-9a53-4eeb-854e-b0fdb935b988", "tag": "5e770c17-96cf-4ce2-978c-506668bd4d86"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:34.376885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-0c64d388-76a5-4129-9bb0-174679cce911 req-d46043d6-5f20-4f7f-b7c8-80677605d759 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.377325 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-0c64d388-76a5-4129-9bb0-174679cce911 req-d46043d6-5f20-4f7f-b7c8-80677605d759 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.398506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-0c64d388-76a5-4129-9bb0-174679cce911 req-d46043d6-5f20-4f7f-b7c8-80677605d759 service nova] Creating event network-changed:5e770c17-96cf-4ce2-978c-506668bd4d86 for instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 on hv-cinder-79578 May 13 14:03:34.403999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:34.404192 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-0c64d388-76a5-4129-9bb0-174679cce911 req-d46043d6-5f20-4f7f-b7c8-80677605d759 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043645 May 13 14:03:34.405002 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 640/1289] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:34.412687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-41a92dd1-57ed-4924-b4c6-3968e419d84f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1682 microversion: 2.1 time: 0.168502 May 13 14:03:34.413273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 650/1290] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:34 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:34.867126 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:34.868274 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: 45f0ae3e-2ace-4327-bc72-93aaf6885296] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:34.875461 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.875904 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.876675 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:34.877104 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:34.891450 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] HTTP exception thrown: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Request method failure captured: May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 HTTP/1.1 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmJusgGc9RN5Z1vrUktnPHSASBacGAkXCu3ysmOX-E7typOT2S3N72_9OeUhR6ome_uufc9kOzBahqe1nhkYM5AjNJMCkhjMJWdRAHmNipRZWKN3gq5qEWazTnqQfDwEJh9V1RdXbisQnMyrI7lAWaNwdTtpVBOg811isE75KN3cm7M May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:03:34.893090 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f52886f21f64392889649d64be8b3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestVolumeBootPattern-681955838 May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 1554793dc7934f9889da636263301ecf May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. May 13 14:03:34.894764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '45f0ae3e-2ace-4327-bc72-93aaf6885296'} May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:34.895807 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. May 13 14:03:34.897269 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:34.898745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Returning 404 to user: Instance 45f0ae3e-2ace-4327-bc72-93aaf6885296 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:34.898745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e27610f8-6a3a-4f2a-9d22-e06544438c12 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296" status: 404 len: 111 microversion: 2.1 time: 0.035170 May 13 14:03:34.898745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 641/1291] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:34 2022] GET /compute/v2.1/servers/45f0ae3e-2ace-4327-bc72-93aaf6885296 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:35.156729 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:35.157311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:35.164223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.164665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.165545 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.165978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.297152 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:35.304712 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-40294754-52bd-45a0-b38f-36f9dd71ddbc tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.151904 May 13 14:03:35.305371 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 651/1292] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:35 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:35.360895 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:35.361406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:35.367507 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.367961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.368718 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.369151 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.382600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] HTTP exception thrown: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Request method failure captured: May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 HTTP/1.1 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmJusgGc9RN5Z1vrUktnPHSASBacGAkXCu3ysmOX-E7typOT2S3N72_9OeUhR6ome_uufc9kOzBahqe1nhkYM5AjNJMCkhjMJWdRAHmNipRZWKN3gq5qEWazTnqQfDwEJh9V1RdXbisQnMyrI7lAWaNwdTtpVBOg811isE75KN3cm7M May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:03:35.384424 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f52886f21f64392889649d64be8b3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 1554793dc7934f9889da636263301ecf May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.386187 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'dd2efb78-1e20-4245-99cc-bbe58cb016d3'} May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:35.389091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.390440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:03:35.391988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Returning 404 to user: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:35.391988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7b81f83f-7d58-4388-ac9c-4bb23cddc700 tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "DELETE /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 404 len: 111 microversion: 2.1 time: 0.029171 May 13 14:03:35.391988 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 642/1293] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:35 2022] DELETE /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:35.396094 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:35.396785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] [instance: dd2efb78-1e20-4245-99cc-bbe58cb016d3] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:35.405461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.405923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.406736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.407172 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.421242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] HTTP exception thrown: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Request method failure captured: May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 HTTP/1.1 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmJusgGc9RN5Z1vrUktnPHSASBacGAkXCu3ysmOX-E7typOT2S3N72_9OeUhR6ome_uufc9kOzBahqe1nhkYM5AjNJMCkhjMJWdRAHmNipRZWKN3gq5qEWazTnqQfDwEJh9V1RdXbisQnMyrI7lAWaNwdTtpVBOg811isE75KN3cm7M May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:03:35.422965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5f52886f21f64392889649d64be8b3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5f52886f21f64392889649d64be8b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 5f52886f21f64392889649d64be8b3d3 May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-TestVolumeBootPattern-681955838 May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 1554793dc7934f9889da636263301ecf May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-TestVolumeBootPattern-681955838-project May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.424474 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'dd2efb78-1e20-4245-99cc-bbe58cb016d3'} May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:35.425289 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. May 13 14:03:35.426730 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:35.428167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Returning 404 to user: Instance dd2efb78-1e20-4245-99cc-bbe58cb016d3 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:35.428167 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2bc3b5ae-0bdb-4539-82c6-21b247bcce8b tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3" status: 404 len: 111 microversion: 2.1 time: 0.033824 May 13 14:03:35.429307 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 652/1294] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:35 2022] GET /compute/v2.1/servers/dd2efb78-1e20-4245-99cc-bbe58cb016d3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:35.430570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:35.431629 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:35.438135 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.438651 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.439617 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:35.440110 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:35.640103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:35.649311 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-aed355f7-d21c-487e-9dc9-89b0ada98b0e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1682 microversion: 2.1 time: 0.222682 May 13 14:03:35.649985 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 643/1295] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:35 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:36.336633 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:36.337546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:36.345871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:36.347275 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:36.348241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:36.348660 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:36.592911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:36.600505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-280115d7-7992-4e6e-a691-95731ebc6b86 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.280963 May 13 14:03:36.601422 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 653/1296] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:36 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:36.667271 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:36.668468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:36.675045 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:36.675493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:36.676586 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:36.677313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:36.740247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-da59ae3d-62fb-47d4-a049-0a1602a57abf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] Calling method '.version_select at 0x7ff15913e820>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:36.764599 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-da59ae3d-62fb-47d4-a049-0a1602a57abf tempest-TestVolumeBootPattern-681955838 tempest-TestVolumeBootPattern-681955838-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1285115109" status: 202 len: 0 microversion: 2.1 time: 0.033704 May 13 14:03:36.765513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 654/1297] 10.222.0.24 () {58 vars in 1262 bytes} [Fri May 13 14:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1285115109 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:03:36.863025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:36.871124 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cded2c23-be81-490f-9bd5-3fb3cee59ec7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1682 microversion: 2.1 time: 0.207769 May 13 14:03:36.871817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 644/1298] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:36 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:37.311353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-70291583-636b-41f8-940d-aec91c685f24 req-11f194f1-2a5c-4dad-bb03-988ad2248f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b1c277-1049-4450-b506-96dff869d8dc", "name": "network-vif-deleted", "tag": "4352eab2-ad01-4078-b24d-75fa21a8db75"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:37.319591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-70291583-636b-41f8-940d-aec91c685f24 req-11f194f1-2a5c-4dad-bb03-988ad2248f4a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:37.320277 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-70291583-636b-41f8-940d-aec91c685f24 req-11f194f1-2a5c-4dad-bb03-988ad2248f4a service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:37.332665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-70291583-636b-41f8-940d-aec91c685f24 req-11f194f1-2a5c-4dad-bb03-988ad2248f4a service nova] Creating event network-vif-deleted:4352eab2-ad01-4078-b24d-75fa21a8db75 for instance 93b1c277-1049-4450-b506-96dff869d8dc on hv-cinder-79578 May 13 14:03:37.338505 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-70291583-636b-41f8-940d-aec91c685f24 req-11f194f1-2a5c-4dad-bb03-988ad2248f4a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 May 13 14:03:37.346273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 655/1299] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:37.617577 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:37.618302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:37.624757 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:37.625322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:37.626379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:37.626869 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:37.821780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:37.830982 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-53d2c546-6b1b-4b7f-8e65-74eee25b8d38 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.217333 May 13 14:03:37.831775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 645/1300] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:37 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:37.890685 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:37.891529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:37.897826 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:37.898407 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:37.899244 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:37.899753 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:37.964927 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:37.973350 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-7817d6de-26ea-4f97-b35d-9476fe72956c tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1615 microversion: 2.1 time: 0.087528 May 13 14:03:37.982533 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 656/1301] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:37 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:38.848008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:38.849265 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:38.857014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:38.857462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:38.858280 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:38.858708 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:38.990857 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:38.992019 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:38.998554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:39.000084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:39.000544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:39.001332 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:39.001919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:39.006949 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d9c4904d-218e-49d5-99ec-e9e47aca7eff tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.162843 May 13 14:03:39.007772 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 646/1302] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:38 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:39.133092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:39.142265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-aa7f122a-761a-4c9a-b1d8-591a618c6f44 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 200 len: 1615 microversion: 2.1 time: 0.155298 May 13 14:03:39.142886 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 657/1303] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:38 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 1615 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:40.025079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.026377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:40.037203 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:40.037657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:40.038998 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:40.039646 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:40.162951 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.163722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:40.180768 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:40.181402 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:40.183002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:40.183546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:40.214743 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc HTTP/1.1 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:03:40.216668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:03:40.219056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '93b1c277-1049-4450-b506-96dff869d8dc'} May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:40.219942 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:03:40.221425 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:40.224339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:40.225892 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-58663d42-7b4f-4c40-a8d5-3025d5b9aca7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 404 len: 111 microversion: 2.1 time: 0.067561 May 13 14:03:40.226938 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 658/1304] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:40 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:40.240748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5cdda5bf-8821-41b4-a7a3-87a6669279c8 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '.version_select at 0x7ff1591c7e50>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.256567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:40.267950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5cdda5bf-8821-41b4-a7a3-87a6669279c8 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248807449" status: 202 len: 0 microversion: 2.1 time: 0.032865 May 13 14:03:40.268283 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-fac000e9-80a0-47c5-a809-d16c10c32c7e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.247627 May 13 14:03:40.268681 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 659/1305] 10.222.0.24 () {58 vars in 1220 bytes} [Fri May 13 14:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248807449 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:40.269291 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 647/1306] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:40 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:41.289062 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:41.289765 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:41.296648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.297092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.297840 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.298305 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.433622 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:41.441749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fc8dde05-f8f0-4113-8ece-e0f236fdb382 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.157046 May 13 14:03:41.442710 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 660/1307] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:41 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:41.551242 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-f88346f7-2224-473a-8454-c12a5015e44e req-386ba15a-49d7-45bb-8734-94f48f615109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e7e99c-9a53-4eeb-854e-b0fdb935b988", "name": "network-vif-plugged", "status": "completed", "tag": "5e770c17-96cf-4ce2-978c-506668bd4d86"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:41.561791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-f88346f7-2224-473a-8454-c12a5015e44e req-386ba15a-49d7-45bb-8734-94f48f615109 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.563008 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-f88346f7-2224-473a-8454-c12a5015e44e req-386ba15a-49d7-45bb-8734-94f48f615109 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.576086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-f88346f7-2224-473a-8454-c12a5015e44e req-386ba15a-49d7-45bb-8734-94f48f615109 service nova] Creating event network-vif-plugged:5e770c17-96cf-4ce2-978c-506668bd4d86 for instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 on hv-cinder-79578 May 13 14:03:41.581921 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-f88346f7-2224-473a-8454-c12a5015e44e req-386ba15a-49d7-45bb-8734-94f48f615109 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034632 May 13 14:03:41.582865 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 648/1308] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:41.672077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:41.672578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:41.678977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.679492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.680269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.681198 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.785812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'services' on Instance uuid 62ecf924-4cfd-40a6-8d24-66b488062838 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:41.873862 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-45b2a7ce-e0b6-4cef-8bf1-a456b68b7153 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments/45659754-be72-499a-9345-8aca07469ed1" status: 202 len: 0 microversion: 2.1 time: 0.206152 May 13 14:03:41.874511 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 661/1309] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:03:41 2022] DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments/45659754-be72-499a-9345-8aca07469ed1 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:41.883302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:41.884319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:41.890830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.891275 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.892046 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:41.892483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:41.921775 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-209f9056-a6ec-40c9-9e4c-9c987c6a2863 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 May 13 14:03:41.922374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 649/1310] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:03:41 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:42.459367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:42.460059 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:42.467219 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:42.467664 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:42.468471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:42.468898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:42.611272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:42.619246 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-082bc04d-63a1-49b2-a14a-48408d55fa41 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1315 microversion: 2.1 time: 0.164494 May 13 14:03:42.619819 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 662/1311] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:42 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:42.932938 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:42.934918 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:42.941830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:42.942544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:42.943504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:42.944089 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:42.976976 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-4eb0e8fe-5340-4b3c-8436-8366130b930f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047966 May 13 14:03:42.977549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 650/1312] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:03:42 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:43.636970 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.637757 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:43.645352 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.645827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.646708 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.647286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.808447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:43.816381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a74426c1-7980-489b-b2c3-0613698a4fe3 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1465 microversion: 2.1 time: 0.183784 May 13 14:03:43.816965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 663/1313] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:43 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:43.855782 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.856285 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:43.862284 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.862754 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.863521 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.863954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.888587 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Going to try to terminate instance {{(pid=123954) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:43.977075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ef18098b-458f-4d3d-8da5-50fc86a46f53 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "DELETE /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 204 len: 0 microversion: 2.1 time: 0.125289 May 13 14:03:43.977832 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 651/1314] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:43 2022] DELETE /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:03:43.987770 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.988591 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:43.989935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.991581 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:43.997141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.997843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.998766 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.999032 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:43.999262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:43.999778 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:44.000048 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:44.000488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:44.042437 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-205005cf-c472-43cb-b702-62816e9914ad tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057587 May 13 14:03:44.043628 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 652/1315] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:03:43 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:44.164690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:44.173302 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-77be127d-40f8-4343-bd23-6817a2a1fae7 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1471 microversion: 2.1 time: 0.190159 May 13 14:03:44.185744 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 664/1316] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:43 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:45.055548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:45.056431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:45.062809 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:45.063295 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:45.064001 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:45.064596 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:45.100499 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e2c5eefe-23aa-4742-9f74-6b7155235f6b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 May 13 14:03:45.101099 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 653/1317] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:03:45 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:45.190893 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:45.191829 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:45.202527 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:45.203300 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:45.204745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:45.205725 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:45.362292 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:45.371040 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b6145f84-15e4-43ea-991a-a1ebf55d960e tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1471 microversion: 2.1 time: 0.183737 May 13 14:03:45.371643 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 665/1318] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:45 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:46.112506 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:46.113448 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:46.125320 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.125935 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.126141 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-dd9e1389-b4be-4c8c-93e5-281a1fe478ce req-ced3f41c-451a-43a2-9827-6d35aeaa8c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e7e99c-9a53-4eeb-854e-b0fdb935b988", "name": "network-vif-deleted", "tag": "5e770c17-96cf-4ce2-978c-506668bd4d86"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:46.127202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.129737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.136054 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-dd9e1389-b4be-4c8c-93e5-281a1fe478ce req-ced3f41c-451a-43a2-9827-6d35aeaa8c7d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.136969 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-dd9e1389-b4be-4c8c-93e5-281a1fe478ce req-ced3f41c-451a-43a2-9827-6d35aeaa8c7d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.152866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-dd9e1389-b4be-4c8c-93e5-281a1fe478ce req-ced3f41c-451a-43a2-9827-6d35aeaa8c7d service nova] Creating event network-vif-deleted:5e770c17-96cf-4ce2-978c-506668bd4d86 for instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 on hv-cinder-79578 May 13 14:03:46.160280 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-dd9e1389-b4be-4c8c-93e5-281a1fe478ce req-ced3f41c-451a-43a2-9827-6d35aeaa8c7d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037999 May 13 14:03:46.160903 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 666/1319] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:46.170936 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-3dbc2f2a-36c6-446d-ae4e-6f1d23b27044 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062388 May 13 14:03:46.171531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 654/1320] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:03:46 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:03:46.242570 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:46.243463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:46.251314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.251912 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.252887 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.253326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.279509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:46.362779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c7054215-c1e6-4e14-9e7b-ef2a1a860c4d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 204 len: 0 microversion: 2.1 time: 0.125267 May 13 14:03:46.363380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 667/1321] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:03:46 2022] DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:03:46.371825 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:46.372563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:46.378820 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.379278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.380050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.380486 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.389114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:46.389816 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:46.395796 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.396374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.397223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.397717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.429310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:46.429751 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:46.430337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.objects.instance [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lazy-loading 'fault' on Instance uuid 45e7e99c-9a53-4eeb-854e-b0fdb935b988 {{(pid=123955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:46.471592 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22277902a7749358c1029fc505d64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8380839a09084b5a920567a1c5894518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:46.479467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c8114de0-6100-429d-a5f0-03453694b30c tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 200 len: 1305 microversion: 2.1 time: 0.094771 May 13 14:03:46.480224 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 668/1322] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:46 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:46.512864 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:46.522396 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-09de27ef-1fd9-418a-8b02-c16f7352cd03 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1681 microversion: 2.1 time: 0.154239 May 13 14:03:46.522943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 655/1323] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:46 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:47.499586 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:47.500267 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] [instance: 45e7e99c-9a53-4eeb-854e-b0fdb935b988] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:47.508169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:47.508696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:47.509588 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:47.510107 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:47.528438 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] HTTP exception thrown: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Request method failure captured: May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 HTTP/1.1 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmUv9WfGhyigyqzJEcoUV0XObTDSCAbVoAKa2NCH1pq0Bn6-orH-RF_KmrfCY3qyk6iQvpy_ZzrpswIPR-DosX-c81U-TUlhcVcROViCPOlkX4uHU3GAGZ3H4DIm7YlSRslnkN_pVFO-bD1o-fhGrvnPyIEjYl39r6b0JOejAYqQisM May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 8380839a09084b5a920567a1c5894518 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesNegativeTest-291092669 May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:03:47.530066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8380839a09084b5a920567a1c5894518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8380839a09084b5a920567a1c5894518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8380839a09084b5a920567a1c5894518"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8380839a09084b5a920567a1c5894518"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesNegativeTest-291092669 May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 8380839a09084b5a920567a1c5894518 May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesNegativeTest-291092669 May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesNegativeTest-291092669-project May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: f22277902a7749358c1029fc505d64e0 May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesNegativeTest-291092669-project May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. May 13 14:03:47.531758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '45e7e99c-9a53-4eeb-854e-b0fdb935b988'} May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:47.532772 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. May 13 14:03:47.534326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:47.535700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] Returning 404 to user: Instance 45e7e99c-9a53-4eeb-854e-b0fdb935b988 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:47.535700 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-69a43ec5-b8c5-4ed5-8bcd-48e775ef4aa6 tempest-VolumesNegativeTest-291092669 tempest-VolumesNegativeTest-291092669-project] 10.222.0.24 "GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988" status: 404 len: 111 microversion: 2.1 time: 0.037051 May 13 14:03:47.536056 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 669/1324] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:47 2022] GET /compute/v2.1/servers/45e7e99c-9a53-4eeb-854e-b0fdb935b988 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:47.543032 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:47.543736 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:47.550172 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:47.550633 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:47.551412 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:47.551853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:47.711053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:47.719432 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1f83fda2-ecd1-464f-9592-a547d23c7ef7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1681 microversion: 2.1 time: 0.181066 May 13 14:03:47.720062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 656/1325] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:47 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:48.439939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-b5732c6e-139c-4377-ba62-5585cd8298d4 req-53ff29d8-f88e-419e-a5d2-eb0303933370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ecf924-4cfd-40a6-8d24-66b488062838", "name": "network-vif-deleted", "tag": "faceb057-7205-4f60-9de5-e4f95841e5ad"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:48.454250 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b5732c6e-139c-4377-ba62-5585cd8298d4 req-53ff29d8-f88e-419e-a5d2-eb0303933370 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:48.454759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b5732c6e-139c-4377-ba62-5585cd8298d4 req-53ff29d8-f88e-419e-a5d2-eb0303933370 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:48.466381 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-b5732c6e-139c-4377-ba62-5585cd8298d4 req-53ff29d8-f88e-419e-a5d2-eb0303933370 service nova] Creating event network-vif-deleted:faceb057-7205-4f60-9de5-e4f95841e5ad for instance 62ecf924-4cfd-40a6-8d24-66b488062838 on hv-cinder-79578 May 13 14:03:48.471397 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-b5732c6e-139c-4377-ba62-5585cd8298d4 req-53ff29d8-f88e-419e-a5d2-eb0303933370 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035413 May 13 14:03:48.472014 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 670/1326] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:48.737909 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:48.739724 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:48.747297 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:48.747833 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:48.748709 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:48.749305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:48.790034 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:48.790806 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:48.791552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'fault' on Instance uuid 62ecf924-4cfd-40a6-8d24-66b488062838 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:48.836744 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:48.845068 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cd6940fb-15b4-4e32-ac9f-8bee97eb82c6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 200 len: 1330 microversion: 2.1 time: 0.112083 May 13 14:03:48.845652 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 657/1327] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:48 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:49.862547 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:49.863242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:49.869398 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:49.869844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:49.870823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:49.871286 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:49.884928 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 HTTP/1.1 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:03:49.886742 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:03:49.888354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '62ecf924-4cfd-40a6-8d24-66b488062838'} May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:49.889232 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:03:49.891741 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:03:49.894023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:49.894023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-093e3d1b-a110-4fd8-94a8-705e64158912 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 404 len: 111 microversion: 2.1 time: 0.030918 May 13 14:03:49.894023 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 671/1328] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:49 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:49.898219 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-24a6f4e7-4272-453e-a429-d4d1bedcd3c8 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '.version_select at 0x7ff1543a8b80>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:49.919765 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-24a6f4e7-4272-453e-a429-d4d1bedcd3c8 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310686398" status: 202 len: 0 microversion: 2.1 time: 0.025431 May 13 14:03:49.920496 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 658/1329] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 14:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310686398 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:03:50.579187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-43503865-7a31-418d-b11a-8827579e6695 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: .version_select at 0x7ff159167280>, body: {"keypair": {"name": "tempest-keypair-663520343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5oYvIz5fQY7ffZUiLI8yAhnW7uD30oFr8DrcRHFMbUSQRGI72hPIjxrbJX9xS2Qglz7FwujsOURYXtLlE4ZM6ZxfQN3CRd3X2fxZxpENPJCUNmPLFu+GbY1VaxWun1Mg=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:50.593528 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-43503865-7a31-418d-b11a-8827579e6695 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:03:50.597428 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-43503865-7a31-418d-b11a-8827579e6695 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:03:50.620690 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-43503865-7a31-418d-b11a-8827579e6695 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045358 May 13 14:03:50.621441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 672/1330] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 14:03:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:52.226239 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1263914837", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271e298e-b7ac-45a3-816f-485dc01eb596"}], "security_groups": [{"name": "tempest-securitygroup--1909798416"}], "key_name": "tempest-keypair-663520343", "user_data": "}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:52.328149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] validate_networks() for [('271e298e-b7ac-45a3-816f-485dc01eb596', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:03:52.791847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:03:52.792525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:03:52.793081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:03:52.793488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:03:52.793894 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:03:52.806784 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:52.807228 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:52.808328 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:52.808760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:52.825276 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:03:52.829216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:03:52.840030 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:03:52.842368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:03:52.893264 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-ae35df01-744c-4e4c-8ef7-4b6a801e914b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671787 May 13 14:03:52.893926 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 659/1331] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 14:03:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:03:52.905761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c65e0232-d178-414c-9d26-93e8e10e9427 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:52.906999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c65e0232-d178-414c-9d26-93e8e10e9427 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:52.974717 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c65e0232-d178-414c-9d26-93e8e10e9427 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:52.982794 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c65e0232-d178-414c-9d26-93e8e10e9427 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1241 microversion: 2.1 time: 0.082659 May 13 14:03:52.983668 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 673/1332] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:52 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:53.999943 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:54.000525 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:54.007520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:54.007979 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:54.008737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:54.009202 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:54.081410 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:54.089650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2725820e-7411-46f7-8179-7dfe84b5e3e3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1311 microversion: 2.1 time: 0.093649 May 13 14:03:54.090860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 660/1333] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:53 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:55.108883 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:55.109467 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:55.116531 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:55.116982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:55.117777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:55.118265 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:55.467247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:55.474720 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c2a64364-0abd-422e-8caa-0db2af397c70 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.370797 May 13 14:03:55.484745 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 674/1334] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:55 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:55.729309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-5ecbd499-04cb-43d7-9db4-c010d6fe1d54 req-1ac7e7c9-40e6-4a23-a898-d3e8fcbfef52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bc20be-8d2a-4770-b734-f1493b296504", "tag": "bd6ff86b-21da-471b-b29b-120cd784c0ff"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:55.740262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5ecbd499-04cb-43d7-9db4-c010d6fe1d54 req-1ac7e7c9-40e6-4a23-a898-d3e8fcbfef52 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:55.741027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5ecbd499-04cb-43d7-9db4-c010d6fe1d54 req-1ac7e7c9-40e6-4a23-a898-d3e8fcbfef52 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:55.755992 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-5ecbd499-04cb-43d7-9db4-c010d6fe1d54 req-1ac7e7c9-40e6-4a23-a898-d3e8fcbfef52 service nova] Creating event network-changed:bd6ff86b-21da-471b-b29b-120cd784c0ff for instance b5bc20be-8d2a-4770-b734-f1493b296504 on hv-cinder-79578 May 13 14:03:55.762178 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-5ecbd499-04cb-43d7-9db4-c010d6fe1d54 req-1ac7e7c9-40e6-4a23-a898-d3e8fcbfef52 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035997 May 13 14:03:55.762871 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 661/1335] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:56.493367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:56.493937 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:56.500773 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:56.501241 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:56.501999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:56.502471 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:56.630774 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:56.642114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fd5dd390-09e7-444c-bd1d-0d2b4560abb4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.153306 May 13 14:03:56.642933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 675/1336] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:56 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:57.665972 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:57.667190 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:57.678262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:57.679019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:57.680287 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:57.681021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:57.820859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:57.831114 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d05992d4-eb74-4f82-b428-70eeb57ca9f1 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.172968 May 13 14:03:57.831669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 662/1337] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:57 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:58.851854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:58.852915 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:58.863756 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:58.864507 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:58.865777 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:58.866558 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:58.999105 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:59.006561 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-87bfa0e3-fe6d-4781-987e-fb09fc0c8d78 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.161191 May 13 14:03:59.007113 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 676/1338] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:03:58 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:00.025483 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:00.026505 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:00.034240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:00.034742 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:00.035592 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:00.036076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:00.176371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:00.184062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-c72200f1-a63a-4b31-89be-ce7f982f718a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.162961 May 13 14:04:00.184870 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 663/1339] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:00 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:01.204875 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:01.205722 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:01.215692 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.216394 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.217521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.218197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.370585 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:01.383025 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2037cf23-feb5-4197-9f04-a69422ff10f7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.184373 May 13 14:04:01.383948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 677/1340] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:01 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:02.406380 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:02.407216 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:02.415541 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:02.416102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:02.417067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:02.417613 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:02.560514 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:02.568240 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-053d291a-bb77-444b-a18d-4d02352a14b0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.168746 May 13 14:04:02.568828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 664/1341] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:02 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:03.585395 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:03.586490 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:03.594374 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:03.594839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:03.595619 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:03.596054 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:03.732759 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:03.740366 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c65dccd7-7343-4e2f-b5c1-5eef43851f95 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.159158 May 13 14:04:03.741190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 678/1342] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:03 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:04.757173 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:04.757796 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:04.765176 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:04.765631 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:04.766463 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:04.766901 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:04.911834 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:04.919493 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2102ecc9-fe30-4ebf-b1d7-a057cbfadd36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.166310 May 13 14:04:04.920088 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 665/1343] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:04 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:05.677537 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-cb4530b6-c861-4418-b80f-66e2eae3e76c req-484f3b85-af16-4371-b148-af9cfe984ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bc20be-8d2a-4770-b734-f1493b296504", "name": "network-vif-plugged", "status": "completed", "tag": "bd6ff86b-21da-471b-b29b-120cd784c0ff"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:05.686967 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-cb4530b6-c861-4418-b80f-66e2eae3e76c req-484f3b85-af16-4371-b148-af9cfe984ff0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:05.687501 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-cb4530b6-c861-4418-b80f-66e2eae3e76c req-484f3b85-af16-4371-b148-af9cfe984ff0 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:05.700367 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-cb4530b6-c861-4418-b80f-66e2eae3e76c req-484f3b85-af16-4371-b148-af9cfe984ff0 service nova] Creating event network-vif-plugged:bd6ff86b-21da-471b-b29b-120cd784c0ff for instance b5bc20be-8d2a-4770-b734-f1493b296504 on hv-cinder-79578 May 13 14:04:05.705662 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-cb4530b6-c861-4418-b80f-66e2eae3e76c req-484f3b85-af16-4371-b148-af9cfe984ff0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 May 13 14:04:05.710629 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 679/1344] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:05.936502 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:05.937068 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:05.943426 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:05.943877 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:05.944657 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:05.945094 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:06.077814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:06.088993 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-b7ccb002-a8a4-4569-a424-e5b49c20d905 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.156250 May 13 14:04:06.089803 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 666/1345] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:05 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:07.115214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:07.116205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:07.127492 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:07.128269 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:07.129509 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:07.130272 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:07.267861 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:07.276164 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6cf2fe5c-6530-441d-a805-3747c5d0ff48 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1367 microversion: 2.1 time: 0.167795 May 13 14:04:07.276732 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 680/1346] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:07 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:08.295050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:08.295674 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:08.305508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.306095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.307287 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.307872 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.454791 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:08.466480 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-05944efc-e758-406b-bd39-a9650a83ad58 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1558 microversion: 2.1 time: 0.175997 May 13 14:04:08.467800 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 667/1347] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:08 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:08.492195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:08.492769 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:08.502945 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.503569 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.504652 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.505318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.589391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0c791631-47ed-4eb0-a9f7-016a14f7ca36 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103188 May 13 14:04:08.590378 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 681/1348] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 14:04:08 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:09.608445 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-5a8f0f4d-f4d9-49fc-be01-5a7dc907f52b req-938d4830-cb1c-4371-8128-9aa0be0a3f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bc20be-8d2a-4770-b734-f1493b296504", "tag": "bd6ff86b-21da-471b-b29b-120cd784c0ff"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:09.617118 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5a8f0f4d-f4d9-49fc-be01-5a7dc907f52b req-938d4830-cb1c-4371-8128-9aa0be0a3f83 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:09.617638 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5a8f0f4d-f4d9-49fc-be01-5a7dc907f52b req-938d4830-cb1c-4371-8128-9aa0be0a3f83 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:09.629160 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-5a8f0f4d-f4d9-49fc-be01-5a7dc907f52b req-938d4830-cb1c-4371-8128-9aa0be0a3f83 service nova] Creating event network-changed:bd6ff86b-21da-471b-b29b-120cd784c0ff for instance b5bc20be-8d2a-4770-b734-f1493b296504 on hv-cinder-79578 May 13 14:04:09.634764 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-5a8f0f4d-f4d9-49fc-be01-5a7dc907f52b req-938d4830-cb1c-4371-8128-9aa0be0a3f83 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030371 May 13 14:04:09.635373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 668/1349] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:43.370623 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:43.371733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:43.379223 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:43.379761 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:43.380666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:43.381183 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:43.467502 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c691e6bd-db90-4aa9-839b-4ca65df29117 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action" status: 202 len: 0 microversion: 2.1 time: 0.103343 May 13 14:04:43.468175 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 682/1350] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 14:04:43 2022] POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:04:43.478485 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:43.479161 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:43.486154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:43.486604 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:43.487379 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:43.488753 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:43.808322 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:43.816351 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-480faacc-4c62-44c4-b4dc-40c07fae1070 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1752 microversion: 2.1 time: 0.342930 May 13 14:04:43.816942 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 669/1351] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:43 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1752 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:44.836898 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:44.837660 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:44.844489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:44.844950 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:44.845755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:44.846247 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:45.043190 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:45.051432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5013e3ec-e510-42fa-98b1-6ed2a38af3fb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.220469 May 13 14:04:45.051993 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 683/1352] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:44 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:46.072920 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:46.073543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:46.080737 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:46.081215 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:46.082031 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:46.082603 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:46.245600 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:46.253660 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2080e198-4902-4dd2-86eb-e8c3a130913a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.187112 May 13 14:04:46.254307 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 670/1353] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:46 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:47.274748 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:47.275880 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:47.282333 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:47.282782 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:47.283546 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:47.283982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:47.435053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:47.443376 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-129f7f88-b7d2-419a-a4e8-335f3996b965 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.174979 May 13 14:04:47.443962 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 684/1354] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:47 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:48.462520 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:48.463222 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:48.471205 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:48.471734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:48.472648 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:48.473156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:48.621944 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:48.635636 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-010a9bbc-bbec-4ae3-97e7-436401af2086 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.176699 May 13 14:04:48.636450 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 671/1355] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:48 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:49.662696 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:49.663684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:49.671661 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:49.672103 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:49.672864 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:49.673287 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:49.848143 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:49.857830 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6122e18b-6b8a-483a-aa20-47397bb45ff4 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.201538 May 13 14:04:49.858513 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 685/1356] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:49 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:50.880810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:50.881824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:50.893687 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:50.894495 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:50.895771 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:50.896498 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:51.048209 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:51.059050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-1c45a611-5bf6-413c-ac74-b8f4204f8fd7 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.184981 May 13 14:04:51.059623 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 672/1357] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:50 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:52.080648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:52.081553 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:52.092349 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:52.093093 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:52.094410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:52.095136 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:52.253337 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:52.265413 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-fa9c930d-e928-427a-a484-7088c69cd7cb tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.191241 May 13 14:04:52.266317 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 686/1358] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:52 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:53.288108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:53.288712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:53.296147 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:53.296603 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:53.297383 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:53.297823 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:53.447431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:53.456193 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-621d7af3-519e-4c62-a8f4-d964162fa752 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.172130 May 13 14:04:53.456761 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 673/1359] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:53 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:54.476987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:54.477991 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:54.489091 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:54.489812 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:54.491150 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:54.491866 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:54.646978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:54.655739 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d6fde32d-f976-4ff3-ab1e-8a4806ed591a tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1757 microversion: 2.1 time: 0.185383 May 13 14:04:54.656298 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 687/1360] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:54 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:55.675155 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:55.675794 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:55.682605 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:55.683040 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:55.683817 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:55.684260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:55.844654 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:55.855378 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-7eabf179-88e6-42e9-9b87-8383e61d179b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1760 microversion: 2.1 time: 0.185233 May 13 14:04:55.856071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 674/1361] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:04:55 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:37.246806 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:37.247662 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:37.258566 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:37.259313 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:37.260602 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:37.261549 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:37.287542 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-24874b52-5b68-4ec5-a68f-e60155f68842 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/ips" status: 200 len: 150 microversion: 2.1 time: 0.047470 May 13 14:05:37.288122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 688/1362] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:05:37 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:38.629257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b16c8ab-7327-4a94-a078-76a8daa4e4fb"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:38.630373 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:38.636342 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:38.636810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:38.637549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:38.638033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:38.905317 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d8c2500c-07ec-42d3-a9bb-fff7577e7138 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280064 May 13 14:05:38.906075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 675/1363] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:05:38 2022] POST /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:46.472077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b16c8ab-7327-4a94-a078-76a8daa4e4fb"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:46.473147 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:46.480473 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.480923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.481694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.482157 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.562318 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: POST /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments HTTP/1.1 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 74 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:05:46.564126 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {"volumeAttachment": {"volumeId": "0b16c8ab-7327-4a94-a078-76a8daa4e4fb"}} May 13 14:05:46.565682 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'server_id': 'b5bc20be-8d2a-4770-b734-f1493b296504', 'body': {'volumeAttachment': {'volumeId': '0b16c8ab-7327-4a94-a078-76a8daa4e4fb'}}} May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:46.567079 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:46.568933 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 400 to user: Invalid volume: volume 0b16c8ab-7327-4a94-a078-76a8daa4e4fb is already attached to instances: b5bc20be-8d2a-4770-b734-f1493b296504 {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-dd7d61ae-2c6d-4e5a-9c4a-2674620ad83f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097523 May 13 14:05:46.570678 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 689/1364] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:05:46 2022] POST /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 14:05:46.629183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:46.630262 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:46.637334 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.637780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.638591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.639022 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.727315 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'services' on Instance uuid b5bc20be-8d2a-4770-b734-f1493b296504 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:05:46.806371 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a40bf51f-3df6-4aed-847f-16608f6978d4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments/0b16c8ab-7327-4a94-a078-76a8daa4e4fb" status: 202 len: 0 microversion: 2.1 time: 0.181799 May 13 14:05:46.807042 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 676/1365] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:05:46 2022] DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments/0b16c8ab-7327-4a94-a078-76a8daa4e4fb => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:05:46.816495 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:46.818193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:46.825389 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.825854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.826693 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:46.827116 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:46.856999 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-07278b6f-9e11-471c-9ab6-b7a312faea02 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 May 13 14:05:46.857578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 690/1366] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:05:46 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:47.870391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:47.871489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:47.878076 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:47.878601 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:47.879374 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:47.879811 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:47.910394 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-db6503af-fd8b-4a38-a141-dbe5a90b8ed4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045002 May 13 14:05:47.910960 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 677/1367] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:05:47 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:05:47.968611 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:47.969142 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:47.975949 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:47.976326 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:47.977084 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:47.977515 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:48.002203 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:05:48.085253 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e63286c-c507-4524-b319-0de7a3162a4b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 204 len: 0 microversion: 2.1 time: 0.120278 May 13 14:05:48.085914 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 691/1368] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:05:47 2022] DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:05:48.094231 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:48.094850 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:48.101462 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:48.101919 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:48.102717 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:48.103159 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:48.242489 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:48.253751 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cde59662-7048-43b9-addf-b4bfc5328027 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1682 microversion: 2.1 time: 0.163151 May 13 14:05:48.254602 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 678/1369] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:48 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:49.273906 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:49.274618 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:49.281998 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:49.282481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:49.283257 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:49.283694 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:49.416536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:49.424758 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-cd78edd3-819a-4272-ba18-8ebcf77dbdaf tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1682 microversion: 2.1 time: 0.155649 May 13 14:05:49.425338 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 692/1370] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:49 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:50.443405 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:50.443980 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:50.450814 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:50.451260 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:50.452027 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:50.452455 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:50.589576 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:50.598085 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2c7d956b-2678-49b7-8842-b3d1f06bcd77 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1682 microversion: 2.1 time: 0.158703 May 13 14:05:50.598780 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 679/1371] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:50 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:51.245723 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-d4e065f6-4cfc-4b5c-9725-f9774da04c9f req-1a97c75f-f5eb-4334-949b-bc518a43e49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bc20be-8d2a-4770-b734-f1493b296504", "name": "network-vif-deleted", "tag": "bd6ff86b-21da-471b-b29b-120cd784c0ff"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:51.257301 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d4e065f6-4cfc-4b5c-9725-f9774da04c9f req-1a97c75f-f5eb-4334-949b-bc518a43e49b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:51.257867 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d4e065f6-4cfc-4b5c-9725-f9774da04c9f req-1a97c75f-f5eb-4334-949b-bc518a43e49b service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:51.276868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-d4e065f6-4cfc-4b5c-9725-f9774da04c9f req-1a97c75f-f5eb-4334-949b-bc518a43e49b service nova] Creating event network-vif-deleted:bd6ff86b-21da-471b-b29b-120cd784c0ff for instance b5bc20be-8d2a-4770-b734-f1493b296504 on hv-cinder-79578 May 13 14:05:51.282983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-d4e065f6-4cfc-4b5c-9725-f9774da04c9f req-1a97c75f-f5eb-4334-949b-bc518a43e49b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041142 May 13 14:05:51.283711 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 693/1372] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:51.616476 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:51.617058 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:51.624121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:51.624563 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:51.625335 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:51.625788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:51.659883 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:51.660334 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:51.660806 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'fault' on Instance uuid b5bc20be-8d2a-4770-b734-f1493b296504 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:05:51.705093 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:51.716427 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6bc88185-b3e6-4095-b072-e2852624bd52 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 200 len: 1331 microversion: 2.1 time: 0.104209 May 13 14:05:51.717019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 680/1373] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:51 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:52.735214 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:52.735917 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:52.743578 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:52.744030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:52.744804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:52.745242 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:52.759043 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 HTTP/1.1 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:05:52.760671 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:05:52.762348 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'b5bc20be-8d2a-4770-b734-f1493b296504'} May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:05:52.763308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:05:52.764827 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:05:52.766354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:05:52.766354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-197d0123-8644-47f1-bb04-b892effd8763 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 404 len: 111 microversion: 2.1 time: 0.031679 May 13 14:05:52.766354 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 694/1374] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:52 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:05:52.771055 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a6a71976-a167-426b-a734-c20e7c31733d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '.version_select at 0x7ff1541815e0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:52.793254 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a6a71976-a167-426b-a734-c20e7c31733d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663520343" status: 202 len: 0 microversion: 2.1 time: 0.025968 May 13 14:05:52.793828 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 681/1375] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 14:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663520343 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:05:53.439134 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a0d48ffd-814e-4e3d-8c7f-bf5c49d73d0a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: .version_select at 0x7ff15913e040>, body: {"keypair": {"name": "tempest-keypair-986650287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFEkYZ9JWvdri1BqYZIfP9IlgrFvM5zDUOLMivPjyETInzHjebwS9pW7pUB5xKnb0WnNpRYpn1cW1k05f3g4jhus+D99KwNWeTlup+o+VmmQiUGm+wbfCWN75bq0CxVeg=="}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:53.453365 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-a0d48ffd-814e-4e3d-8c7f-bf5c49d73d0a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:05:53.457360 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.quota [None req-a0d48ffd-814e-4e3d-8c7f-bf5c49d73d0a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'key_pairs'} {{(pid=123955) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:05:53.481965 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a0d48ffd-814e-4e3d-8c7f-bf5c49d73d0a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046793 May 13 14:05:53.482582 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 695/1376] 10.222.0.24 () {60 vars in 1158 bytes} [Fri May 13 14:05:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:05:54.837053 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-499461406", "imageRef": "af267129-dee0-4077-885b-53b93e31aa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "271e298e-b7ac-45a3-816f-485dc01eb596"}], "security_groups": [{"name": "tempest-securitygroup--1231391949"}], "key_name": "tempest-keypair-986650287", "user_data": "}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:54.943238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.network.neutron [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] validate_networks() for [('271e298e-b7ac-45a3-816f-485dc01eb596', None, None, None, None, None)] {{(pid=123954) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:05:55.325067 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:05:55.325488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image limits 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:05:55.325961 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Flavor pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:05:55.326397 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Image pref 0:0:0 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:05:55.326810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.virt.hardware [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:05:55.337033 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:55.337475 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:55.338309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:55.338743 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:55.355440 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:05:55.359855 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.quota [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Getting quotas for user 4a505a865123477dbcd056cd71eac2f1 and project 7bade007bc7c4a0db90815c691af9265. Resources: {'ram', 'instances', 'cores'} {{(pid=123954) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:05:55.377050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Going to run 1 instances... {{(pid=123954) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:05:55.380707 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af267129-dee0-4077-885b-53b93e31aa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123954) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:05:55.438931 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2da0c2b3-b001-462d-b6b8-b24c729b6cc4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606478 May 13 14:05:55.439592 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 682/1377] 10.222.0.24 () {60 vars in 1146 bytes} [Fri May 13 14:05:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:05:55.450353 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-c48a0777-d759-4670-a9e4-94a577175b59 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:55.450968 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-c48a0777-d759-4670-a9e4-94a577175b59 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:55.505982 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-c48a0777-d759-4670-a9e4-94a577175b59 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:55.514162 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-c48a0777-d759-4670-a9e4-94a577175b59 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1240 microversion: 2.1 time: 0.068191 May 13 14:05:55.514858 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 696/1378] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:55 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:56.533406 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:56.534078 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:56.540836 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:56.541288 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:56.542184 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:56.542634 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:56.609401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:56.617391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-80c4e77e-5871-4ea7-b4d8-ce6e7066ca0b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1300 microversion: 2.1 time: 0.088299 May 13 14:05:56.617882 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 683/1379] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:56 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:05:57.634508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:57.635099 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:57.641560 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:57.642002 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:57.642802 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:57.643231 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:57.863311 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:57.871957 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3e7d1628-1d47-4287-b649-36e16b80e9c9 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.241579 May 13 14:05:57.872714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 697/1380] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:57 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:58.032681 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-0b7149af-81f4-4cd7-b493-367a1d79fd36 req-8575f774-f574-4598-9359-48ee7a7704fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3884081-9669-4c64-91b8-53ebcf48d089", "tag": "842e5e46-e085-4ba9-9363-8c690c7130e0"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:58.045221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-0b7149af-81f4-4cd7-b493-367a1d79fd36 req-8575f774-f574-4598-9359-48ee7a7704fe service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:58.045669 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-0b7149af-81f4-4cd7-b493-367a1d79fd36 req-8575f774-f574-4598-9359-48ee7a7704fe service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:58.061537 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-0b7149af-81f4-4cd7-b493-367a1d79fd36 req-8575f774-f574-4598-9359-48ee7a7704fe service nova] Creating event network-changed:842e5e46-e085-4ba9-9363-8c690c7130e0 for instance c3884081-9669-4c64-91b8-53ebcf48d089 on hv-cinder-79578 May 13 14:05:58.067639 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-0b7149af-81f4-4cd7-b493-367a1d79fd36 req-8575f774-f574-4598-9359-48ee7a7704fe service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040411 May 13 14:05:58.068257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 684/1381] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:58.893624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:58.894703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:58.906308 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:58.907066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:58.908347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:58.909077 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:59.047635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:59.055066 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-b840e8aa-dd90-4206-8861-7955489f6e09 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.168005 May 13 14:05:59.055624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 698/1382] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:05:58 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:00.075677 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:00.076512 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:00.085673 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:00.086167 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:00.086964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:00.087384 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:00.239671 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:00.247853 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-bdd5a57d-e204-44c0-8675-d32b44748e5d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.178304 May 13 14:06:00.248431 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 685/1383] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:00 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:01.265544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:01.266166 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:01.272913 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:01.273463 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:01.274291 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:01.274726 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:01.510015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:01.517845 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-64b0fa8e-918a-42a1-ae52-acb70b829698 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.256670 May 13 14:06:01.518436 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 699/1384] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:01 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:02.539788 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:02.540767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:02.551703 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:02.552439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:02.553698 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:02.554468 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:02.691100 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:02.702626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5d8e0833-56b5-455e-a66d-802f68206f5b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.169060 May 13 14:06:02.703377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 686/1385] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:02 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:03.720461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:03.721046 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:03.727876 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.728324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.729321 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.729755 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.878556 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:03.889529 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-2ead2914-38ff-474c-9c08-6e30afe9125d tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.172735 May 13 14:06:03.890339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 700/1386] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:03 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:04.916414 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:04.917727 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:04.928649 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:04.929368 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:04.930702 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:04.931434 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:05.061446 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:05.069967 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9f9d44c4-3ae4-4231-afcd-423543a320f0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.160271 May 13 14:06:05.070579 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 687/1387] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:04 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:06.087342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:06.087948 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:06.094854 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:06.095395 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.096238 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:06.096954 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.239342 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:06.240324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-23164810-a1fe-4e16-965a-d543f9030c9e req-ce678ddf-b02e-4661-b341-d3a1b0faa540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3884081-9669-4c64-91b8-53ebcf48d089", "name": "network-vif-plugged", "status": "completed", "tag": "842e5e46-e085-4ba9-9363-8c690c7130e0"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:06.247536 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d1f89b3c-5e68-4c97-877f-b31f98a45eb7 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.164223 May 13 14:06:06.248108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 701/1388] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:06 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:06:06.249549 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-23164810-a1fe-4e16-965a-d543f9030c9e req-ce678ddf-b02e-4661-b341-d3a1b0faa540 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:06.250096 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-23164810-a1fe-4e16-965a-d543f9030c9e req-ce678ddf-b02e-4661-b341-d3a1b0faa540 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.261079 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-23164810-a1fe-4e16-965a-d543f9030c9e req-ce678ddf-b02e-4661-b341-d3a1b0faa540 service nova] Creating event network-vif-plugged:842e5e46-e085-4ba9-9363-8c690c7130e0 for instance c3884081-9669-4c64-91b8-53ebcf48d089 on hv-cinder-79578 May 13 14:06:06.266121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-23164810-a1fe-4e16-965a-d543f9030c9e req-ce678ddf-b02e-4661-b341-d3a1b0faa540 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100863 May 13 14:06:06.266708 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 688/1389] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:06:07.267666 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:07.268532 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:07.278695 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.279339 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.280447 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.281072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.417868 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:07.425985 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-d64847c4-23f8-4648-ac52-e0bffc91b4b6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1366 microversion: 2.1 time: 0.164680 May 13 14:06:07.426697 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 702/1390] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:07 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:07.783156 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1568222008"}} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:07.783841 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:07.791050 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.791543 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.792377 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.792838 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.941141 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.network.security_group_api [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Removing security group 0a73dff5-1467-4f53-bec8-b090b8621747 from port 8f0987bb-5d95-4977-92b6-5b0bb6fc079a May 13 14:06:08.289878 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-9cff1658-be24-4a4b-bcb4-b43151c7425d tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action" status: 202 len: 0 microversion: 2.1 time: 0.511753 May 13 14:06:08.290571 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 689/1391] 10.222.0.24 () {60 vars in 1277 bytes} [Fri May 13 14:06:07 2022] POST /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:06:08.300261 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-b11bd1dc-ea0a-44b3-b104-de5113a31ead req-9d9b64ed-c03f-4816-b4b7-a226090ae0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:08.314362 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b11bd1dc-ea0a-44b3-b104-de5113a31ead req-9d9b64ed-c03f-4816-b4b7-a226090ae0fc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.315092 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-b11bd1dc-ea0a-44b3-b104-de5113a31ead req-9d9b64ed-c03f-4816-b4b7-a226090ae0fc service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.337823 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-b11bd1dc-ea0a-44b3-b104-de5113a31ead req-9d9b64ed-c03f-4816-b4b7-a226090ae0fc service nova] Creating event network-changed:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:06:08.345067 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-b11bd1dc-ea0a-44b3-b104-de5113a31ead req-9d9b64ed-c03f-4816-b4b7-a226090ae0fc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046793 May 13 14:06:08.349229 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 703/1392] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:08.447630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:08.448372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:08.454989 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.455438 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.456257 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.456959 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.626343 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:08.634234 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cbe8ce8e-c0da-4ee6-8cc7-a074cddab1fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1556 microversion: 2.1 time: 0.191070 May 13 14:06:08.635148 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 690/1393] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:08 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:08.652207 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:08.653197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:08.661054 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.662078 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.664005 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.665144 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.821983 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-f3d53eb9-9fc3-4688-836d-9b0f62711b57 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173838 May 13 14:06:08.822919 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 704/1394] 10.222.0.24 () {58 vars in 1274 bytes} [Fri May 13 14:06:08 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:09.577714 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:09.578324 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:09.584808 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.585575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.586449 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.586956 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.675925 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lazy-loading 'services' on Instance uuid 510df438-15e0-466f-b42e-282ec3d425b2 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:06:09.767550 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-5f801a02-c4df-4762-8661-ec4caab8f452 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments/89a8e4d6-54cc-4975-92a6-c366a51a764a" status: 202 len: 0 microversion: 2.1 time: 0.194639 May 13 14:06:09.771238 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 691/1395] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:06:09 2022] DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments/89a8e4d6-54cc-4975-92a6-c366a51a764a => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:06:09.779169 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:09.780282 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:09.789733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.790409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.792400 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.793583 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.834380 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-3b3518d6-8e65-4447-a81a-e9a8bb5ee243 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061522 May 13 14:06:09.835050 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 705/1396] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:06:09 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:10.346592 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [req-5b54dbf3-5af0-4ddf-b118-90b81c7c25aa req-1e955dc3-7b3b-4cec-8e3f-3a0b9d8004ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3884081-9669-4c64-91b8-53ebcf48d089", "tag": "842e5e46-e085-4ba9-9363-8c690c7130e0"}]} {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:10.361649 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-8cd95d47-b22a-4cbb-90f2-03779a0002d0 req-d05797ac-045b-41d0-b3e1-ad4840749753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:10.368071 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5b54dbf3-5af0-4ddf-b118-90b81c7c25aa req-1e955dc3-7b3b-4cec-8e3f-3a0b9d8004ce service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.368977 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [req-5b54dbf3-5af0-4ddf-b118-90b81c7c25aa req-1e955dc3-7b3b-4cec-8e3f-3a0b9d8004ce service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.370610 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8cd95d47-b22a-4cbb-90f2-03779a0002d0 req-d05797ac-045b-41d0-b3e1-ad4840749753 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.371030 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-8cd95d47-b22a-4cbb-90f2-03779a0002d0 req-d05797ac-045b-41d0-b3e1-ad4840749753 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.383715 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-8cd95d47-b22a-4cbb-90f2-03779a0002d0 req-d05797ac-045b-41d0-b3e1-ad4840749753 service nova] Creating event network-changed:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:06:10.385152 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.compute.server_external_events [req-5b54dbf3-5af0-4ddf-b118-90b81c7c25aa req-1e955dc3-7b3b-4cec-8e3f-3a0b9d8004ce service nova] Creating event network-changed:842e5e46-e085-4ba9-9363-8c690c7130e0 for instance c3884081-9669-4c64-91b8-53ebcf48d089 on hv-cinder-79578 May 13 14:06:10.389634 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-8cd95d47-b22a-4cbb-90f2-03779a0002d0 req-d05797ac-045b-41d0-b3e1-ad4840749753 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031645 May 13 14:06:10.390653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 706/1397] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:06:10.392618 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [req-5b54dbf3-5af0-4ddf-b118-90b81c7c25aa req-1e955dc3-7b3b-4cec-8e3f-3a0b9d8004ce service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116145 May 13 14:06:10.394021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 692/1398] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:10.848236 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:10.849869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:10.857701 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.858345 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.859273 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.859853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.891781 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-5f2bdcc4-cf34-4855-be8d-8bc81f389a2f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047679 May 13 14:06:10.892934 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 707/1399] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:06:10 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:06:10.904777 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:10.906123 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:10.913933 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.914617 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.915572 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.916163 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:11.016019 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] HTTP exception thrown: Instance 510df438-15e0-466f-b42e-282ec3d425b2 is not attached to volume 89a8e4d6-54cc-4975-92a6-c366a51a764a May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Request method failure captured: May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments/89a8e4d6-54cc-4975-92a6-c366a51a764a HTTP/1.1 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmTbfs04GFpdRTDZ56arzBAhUM68-EA_Veya4KXkYBJCw1xIAe-XhonUN98aLNHwTREdMh0DCqnIzzsh7e_qzniXAVYlWgmUhJSLtNMqPujB85R7V6Cmf5qDwRz-oPnojCw2KjyYkQktald_MsjnyX92pnVjYMpCX5urNfT7ERwmT-o May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 05db243be3a84144ada513f22c0b6076 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:06:11.018694 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/05db243be3a84144ada513f22c0b6076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/05db243be3a84144ada513f22c0b6076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_05db243be3a84144ada513f22c0b6076"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/05db243be3a84144ada513f22c0b6076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 05db243be3a84144ada513f22c0b6076 May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestMinimumBasicScenario-639925758-project May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: d5a3443f5ce445af93cf7a9107a793ea May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestMinimumBasicScenario-639925758-project May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:06:11.020138 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 510df438-15e0-466f-b42e-282ec3d425b2 is not attached to volume 89a8e4d6-54cc-4975-92a6-c366a51a764a May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'server_id': '510df438-15e0-466f-b42e-282ec3d425b2', 'id': '89a8e4d6-54cc-4975-92a6-c366a51a764a'} May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89a8e4d6-54cc-4975-92a6-c366a51a764a. May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:06:11.020907 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510df438-15e0-466f-b42e-282ec3d425b2 is not attached to volume 89a8e4d6-54cc-4975-92a6-c366a51a764a May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510df438-15e0-466f-b42e-282ec3d425b2 is not attached to volume 89a8e4d6-54cc-4975-92a6-c366a51a764a May 13 14:06:11.022206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:11.024419 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Returning 404 to user: Instance 510df438-15e0-466f-b42e-282ec3d425b2 is not attached to volume 89a8e4d6-54cc-4975-92a6-c366a51a764a {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:06:11.025792 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-2fbe73d7-fb6f-4bb8-b490-d9893d718d1b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments/89a8e4d6-54cc-4975-92a6-c366a51a764a" status: 404 len: 154 microversion: 2.1 time: 0.126178 May 13 14:06:11.027041 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 693/1400] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:06:10 2022] DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2/os-volume_attachments/89a8e4d6-54cc-4975-92a6-c366a51a764a => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:06:12.184992 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:12.185508 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:12.191996 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.192441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.193194 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.193625 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.217900 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:06:12.298614 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6bcf603b-e17e-4520-b4b2-7868a0a58fc8 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 204 len: 0 microversion: 2.1 time: 0.117278 May 13 14:06:12.299201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 708/1401] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:06:12 2022] DELETE /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:06:12.309401 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:12.310174 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:12.316365 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.316847 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.317627 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.318130 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.451937 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:12.459556 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-abb5a613-d1b0-4a82-aec7-56589f343a0b tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1554 microversion: 2.1 time: 0.155907 May 13 14:06:12.460121 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 694/1402] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:12 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:13.482684 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:13.483736 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:13.494461 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:13.495197 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:13.496653 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:13.497122 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:13.646184 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:13.654409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-39924746-bac1-4249-9dde-22fdd216efff tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1554 microversion: 2.1 time: 0.179224 May 13 14:06:13.654978 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 709/1403] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:13 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:14.671553 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:14.672206 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:14.679120 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:14.679567 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:14.680341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:14.680798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:14.822149 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a3443f5ce445af93cf7a9107a793ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db243be3a84144ada513f22c0b6076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:14.829789 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6b62f829-2159-46c6-8de1-c508cc46e93e tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 200 len: 1554 microversion: 2.1 time: 0.162474 May 13 14:06:14.839338 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 695/1404] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:14 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:14.908784 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-4872acfd-ba62-4441-a237-71f06a0dbb5a req-f84ccb25-5ee6-4956-ac3a-332d858f6677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510df438-15e0-466f-b42e-282ec3d425b2", "name": "network-vif-deleted", "tag": "8f0987bb-5d95-4977-92b6-5b0bb6fc079a"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:14.918201 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-4872acfd-ba62-4441-a237-71f06a0dbb5a req-f84ccb25-5ee6-4956-ac3a-332d858f6677 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:14.918737 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-4872acfd-ba62-4441-a237-71f06a0dbb5a req-f84ccb25-5ee6-4956-ac3a-332d858f6677 service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:14.930665 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-4872acfd-ba62-4441-a237-71f06a0dbb5a req-f84ccb25-5ee6-4956-ac3a-332d858f6677 service nova] Creating event network-vif-deleted:8f0987bb-5d95-4977-92b6-5b0bb6fc079a for instance 510df438-15e0-466f-b42e-282ec3d425b2 on hv-cinder-79578 May 13 14:06:14.936390 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-4872acfd-ba62-4441-a237-71f06a0dbb5a req-f84ccb25-5ee6-4956-ac3a-332d858f6677 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 May 13 14:06:14.937053 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 710/1405] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:15.851372 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:15.852391 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] [instance: 510df438-15e0-466f-b42e-282ec3d425b2] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:15.861531 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:15.861964 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:15.862763 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:15.863200 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:15.877954 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] HTTP exception thrown: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Request method failure captured: May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 HTTP/1.1 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmTbfs04GFpdRTDZ56arzBAhUM68-EA_Veya4KXkYBJCw1xIAe-XhonUN98aLNHwTREdMh0DCqnIzzsh7e_qzniXAVYlWgmUhJSLtNMqPujB85R7V6Cmf5qDwRz-oPnojCw2KjyYkQktald_MsjnyX92pnVjYMpCX5urNfT7ERwmT-o May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 05db243be3a84144ada513f22c0b6076 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:06:15.879528 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/05db243be3a84144ada513f22c0b6076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/05db243be3a84144ada513f22c0b6076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_05db243be3a84144ada513f22c0b6076"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/05db243be3a84144ada513f22c0b6076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 05db243be3a84144ada513f22c0b6076 May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-TestMinimumBasicScenario-639925758 May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-TestMinimumBasicScenario-639925758-project May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: d5a3443f5ce445af93cf7a9107a793ea May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-TestMinimumBasicScenario-639925758-project May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. May 13 14:06:15.881103 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '510df438-15e0-466f-b42e-282ec3d425b2'} May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:06:15.881952 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. May 13 14:06:15.883680 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:06:15.885270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Returning 404 to user: Instance 510df438-15e0-466f-b42e-282ec3d425b2 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:06:15.885270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-a14d0317-ca02-4036-bf45-3b534c36441f tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2" status: 404 len: 111 microversion: 2.1 time: 0.036318 May 13 14:06:15.885270 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 696/1406] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:06:15 2022] GET /compute/v2.1/servers/510df438-15e0-466f-b42e-282ec3d425b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:06:15.891087 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-558d214a-a360-4e88-a64e-d74efd561bb5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] Calling method '.version_select at 0x7ff159101b80>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:15.911615 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-558d214a-a360-4e88-a64e-d74efd561bb5 tempest-TestMinimumBasicScenario-639925758 tempest-TestMinimumBasicScenario-639925758-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1688352020" status: 202 len: 0 microversion: 2.1 time: 0.024926 May 13 14:06:15.912391 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 711/1407] 10.222.0.24 () {58 vars in 1271 bytes} [Fri May 13 14:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1688352020 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:07:26.430615 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:26.431676 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:26.443421 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:26.444221 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:26.445570 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:26.446319 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:26.476309 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e7fdf4e1-f9fb-4286-811d-e42018b78ae0 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/ips" status: 200 len: 150 microversion: 2.1 time: 0.053789 May 13 14:07:26.476875 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 697/1408] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:07:26 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:27.819687 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7befbea5-bab1-4919-be24-ce3b34290bb7"}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:27.820856 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:27.829231 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:27.829672 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:27.830481 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:27.830911 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:28.106955 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-37cc58e2-2f99-4d2e-a015-a6fddddd015a tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "POST /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292439 May 13 14:07:28.107703 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 712/1409] 10.222.0.24 () {60 vars in 1322 bytes} [Fri May 13 14:07:27 2022] POST /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:35.738169 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:35.738720 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:35.745101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.745541 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.746348 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.746767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.832645 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'services' on Instance uuid c3884081-9669-4c64-91b8-53ebcf48d089 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:07:35.913723 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-8ff64da8-856c-4f8b-a032-cdeead90e09f tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments/7befbea5-bab1-4919-be24-ce3b34290bb7" status: 202 len: 0 microversion: 2.1 time: 0.179529 May 13 14:07:35.914558 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 698/1410] 10.222.0.24 () {58 vars in 1415 bytes} [Fri May 13 14:07:35 2022] DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments/7befbea5-bab1-4919-be24-ce3b34290bb7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:07:35.923544 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:35.924849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:35.931724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.932171 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.932929 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.933364 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.963521 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-bd34202d-4f9b-4031-abe8-e61cbb24131e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044224 May 13 14:07:35.964072 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 713/1411] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:07:35 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:36.979154 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:36.980220 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:36.987091 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.987534 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.988302 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.988734 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:37.018428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-f3e1a2a9-ea7d-4f2b-b6a8-ef8606add9e6 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045358 May 13 14:07:37.019014 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 699/1412] 10.222.0.24 () {58 vars in 1301 bytes} [Fri May 13 14:07:36 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:07:37.075844 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:37.076384 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:37.083347 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:37.083787 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:37.084554 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:37.084984 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:37.109726 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Going to try to terminate instance {{(pid=123955) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:07:37.195457 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-083d4204-7425-499f-ba87-eee25b8f5607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 204 len: 0 microversion: 2.1 time: 0.123257 May 13 14:07:37.196205 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 714/1413] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:07:37 2022] DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:07:37.204417 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:37.205025 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:37.211504 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:37.211951 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:37.212712 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:37.213143 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:37.360661 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:37.369860 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d41cb7ab-4de5-4798-8368-5b787f187726 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1681 microversion: 2.1 time: 0.169269 May 13 14:07:37.370461 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 700/1414] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:37 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:38.392733 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:38.393869 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:38.402329 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:38.402785 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:38.403562 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:38.404001 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:38.538939 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.policy [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123955) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:38.546465 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-6548c02e-669c-4134-8c37-5aa746a80607 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1681 microversion: 2.1 time: 0.160956 May 13 14:07:38.547024 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 715/1415] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:38 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:39.563508 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:39.564108 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:39.571305 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:39.571798 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:39.572560 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:39.572973 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:39.707554 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:39.716824 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6598299c-ed6d-4a86-abb4-16a9fa6fd7b3 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1681 microversion: 2.1 time: 0.157211 May 13 14:07:39.717433 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 701/1416] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:39 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:40.241849 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [req-d0b6f1a3-912a-4e72-8bd8-9f1598508da3 req-bcb6b832-047c-43cf-aab7-7e78f87a397d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3884081-9669-4c64-91b8-53ebcf48d089", "name": "network-vif-deleted", "tag": "842e5e46-e085-4ba9-9363-8c690c7130e0"}]} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:40.251412 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d0b6f1a3-912a-4e72-8bd8-9f1598508da3 req-bcb6b832-047c-43cf-aab7-7e78f87a397d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:40.251863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [req-d0b6f1a3-912a-4e72-8bd8-9f1598508da3 req-bcb6b832-047c-43cf-aab7-7e78f87a397d service nova] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:40.263648 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.compute.server_external_events [req-d0b6f1a3-912a-4e72-8bd8-9f1598508da3 req-bcb6b832-047c-43cf-aab7-7e78f87a397d service nova] Creating event network-vif-deleted:842e5e46-e085-4ba9-9363-8c690c7130e0 for instance c3884081-9669-4c64-91b8-53ebcf48d089 on hv-cinder-79578 May 13 14:07:40.269262 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [req-d0b6f1a3-912a-4e72-8bd8-9f1598508da3 req-bcb6b832-047c-43cf-aab7-7e78f87a397d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 May 13 14:07:40.269853 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 716/1417] 10.222.0.24 () {64 vars in 1317 bytes} [Fri May 13 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:40.735057 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:40.736313 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:40.745308 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:40.745767 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:40.746612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:40.747021 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:40.781101 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:40.781548 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:40.782004 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.objects.instance [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lazy-loading 'fault' on Instance uuid c3884081-9669-4c64-91b8-53ebcf48d089 {{(pid=123954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:07:40.832630 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.policy [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a505a865123477dbcd056cd71eac2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bade007bc7c4a0db90815c691af9265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123954) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:40.841535 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-80820985-2468-4f03-91e6-e6f11ce5f8da tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 200 len: 1330 microversion: 2.1 time: 0.110864 May 13 14:07:40.842151 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 702/1418] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:40 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:41.864714 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:41.865922 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:41.873213 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:41.873667 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:41.874482 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:41.874923 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:41.888543 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 HTTP/1.1 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:41.890173 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:41.892098 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'c3884081-9669-4c64-91b8-53ebcf48d089'} May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:41.892956 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:41.894410 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:41.895727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:41.895727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-941812ad-6828-4ed4-bbb8-1b147640057e tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 404 len: 111 microversion: 2.1 time: 0.034667 May 13 14:07:41.895727 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 717/1419] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:41 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:41.901095 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d9afede1-15d1-4b64-a428-821f4699eda4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '.version_select at 0x7ff1541b8ee0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:41.921198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d9afede1-15d1-4b64-a428-821f4699eda4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986650287" status: 202 len: 0 microversion: 2.1 time: 0.024349 May 13 14:07:41.921745 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 703/1420] 10.222.0.24 () {58 vars in 1217 bytes} [Fri May 13 14:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986650287 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:07:43.714977 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:43.715525 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:43.722192 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:43.722644 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:43.723409 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:43.723839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:43.740330 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 HTTP/1.1 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:43.741863 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.744195 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'c3884081-9669-4c64-91b8-53ebcf48d089'} May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:43.745193 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.746907 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:43.748640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:43.748640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-70be0c96-42a3-4422-9405-82e8d34a2554 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 404 len: 111 microversion: 2.1 time: 0.032208 May 13 14:07:43.748640 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 718/1421] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:07:43 2022] DELETE /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:43.752591 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:43.753198 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: c3884081-9669-4c64-91b8-53ebcf48d089] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:43.760458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:43.760906 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:43.761663 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:43.762086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:43.775715 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 HTTP/1.1 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:07:43.777337 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.779086 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'c3884081-9669-4c64-91b8-53ebcf48d089'} May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:43.780062 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. May 13 14:07:43.781760 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:43.783259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance c3884081-9669-4c64-91b8-53ebcf48d089 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:43.783259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-e1009b16-07d5-4679-a329-a1f7ee4ab9f5 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089" status: 404 len: 111 microversion: 2.1 time: 0.030592 May 13 14:07:43.783259 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 704/1422] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:43 2022] GET /compute/v2.1/servers/c3884081-9669-4c64-91b8-53ebcf48d089 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:44.925724 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:44.926252 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:44.933559 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:44.934010 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:44.934839 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:44.935276 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:44.950124 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 HTTP/1.1 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:44.951657 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.953324 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': 'b5bc20be-8d2a-4770-b734-f1493b296504'} May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:44.954327 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.955924 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:44.957440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:44.957440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-8032c99d-5664-4deb-beaf-257578d3bf06 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 404 len: 111 microversion: 2.1 time: 0.031200 May 13 14:07:44.957440 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 719/1423] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:07:44 2022] DELETE /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:44.963934 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:44.964713 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: b5bc20be-8d2a-4770-b734-f1493b296504] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:44.971230 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:44.971653 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:44.972409 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:44.972839 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:44.986329 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 HTTP/1.1 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:07:44.987885 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.989632 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': 'b5bc20be-8d2a-4770-b734-f1493b296504'} May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:44.990810 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. May 13 14:07:45.001994 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.003666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance b5bc20be-8d2a-4770-b734-f1493b296504 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:45.003666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-125db100-d3bb-4bf6-98c5-8c67c45b100b tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504" status: 404 len: 111 microversion: 2.1 time: 0.031689 May 13 14:07:45.003666 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 705/1424] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:44 2022] GET /compute/v2.1/servers/b5bc20be-8d2a-4770-b734-f1493b296504 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:45.003952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:45.003952 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:45.009187 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:45.009804 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:45.011274 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:45.012013 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:45.030655 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc HTTP/1.1 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:45.032189 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.033987 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '93b1c277-1049-4450-b506-96dff869d8dc'} May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:45.035015 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.036635 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:45.038503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:45.038503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-72c00476-088b-45a1-b53c-68eb6a9cf1c4 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 404 len: 111 microversion: 2.1 time: 0.038581 May 13 14:07:45.038503 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 720/1425] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:07:44 2022] DELETE /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:45.042183 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:45.042797 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 93b1c277-1049-4450-b506-96dff869d8dc] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:45.049102 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:45.049544 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:45.050331 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:45.050758 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:45.064075 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc HTTP/1.1 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:07:45.065562 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.067474 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '93b1c277-1049-4450-b506-96dff869d8dc'} May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:45.068460 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. May 13 14:07:45.070081 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:45.071552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 93b1c277-1049-4450-b506-96dff869d8dc could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:45.071552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-16616c32-3281-4b48-bfab-226d48736390 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc" status: 404 len: 111 microversion: 2.1 time: 0.028730 May 13 14:07:45.071552 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 706/1426] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:45 2022] GET /compute/v2.1/servers/93b1c277-1049-4450-b506-96dff869d8dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:07:46.220735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:46.221263 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.compute.api [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123955) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:46.227843 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:46.228297 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:46.229057 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:46.229489 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG oslo_concurrency.lockutils [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:46.243293 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 HTTP/1.1 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:46.244808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: > May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.246808 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '62ecf924-4cfd-40a6-8d24-66b488062838'} May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:46.247799 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.249431 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:46.251343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:46.251343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-a845538a-14ff-4f7d-8025-514d7c0e4e34 tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 404 len: 111 microversion: 2.1 time: 0.029597 May 13 14:07:46.251343 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 721/1427] 10.222.0.24 () {58 vars in 1238 bytes} [Fri May 13 14:07:46 2022] DELETE /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:46.254859 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Calling method '>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:46.255464 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.compute.api [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] [instance: 62ecf924-4cfd-40a6-8d24-66b488062838] Fetching instance by UUID {{(pid=123954) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:46.262439 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:46.262892 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:46.263650 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:46.264084 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG oslo_concurrency.lockutils [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Lock "5bbb2759-67a0-478c-9905-0185ee945b1d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123954) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:46.278278 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.wsgi [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] HTTP exception thrown: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Request method failure captured: May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: request: GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 HTTP/1.1 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept: application/json May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Accept-Encoding: identity May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Connection: close May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Length: 0 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Content-Type: application/json May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Host: 10.222.0.24 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Openstack-System-Scope: None May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: User-Agent: python-urllib3/1.26.9 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Auth-Token: gAAAAABifmPvQ_4D8AolatAEUC8IMBjuwRJAZRm0v4qMGUMwA1wmEy7gkcw2v96gTG7LAU6HAo_P9HKYVtGqNXo5NBlcBl9gnKNOtyf1b-Xmn0vA1jzE0XPzrmOwzJe4avgcSom-yzRYlKi1x8Uc5T0oNjV23uT1SXqKSmwJIMvJ_xdMktklyvg May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Id: None May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Domain-Name: None May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Identity-Status: Confirmed May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Is-Admin-Project: True May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Id: default May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Domain-Name: Default May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Project-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Role: member,reader May 13 14:07:46.279812 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Roles: member,reader May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bade007bc7c4a0db90815c691af9265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bade007bc7c4a0db90815c691af9265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Id: 7bade007bc7c4a0db90815c691af9265 May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1923347245 May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Id: default May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Domain-Name: Default May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Id: 4a505a865123477dbcd056cd71eac2f1 May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: X-User-Name: tempest-AttachVolumeNegativeTest-1923347245-project May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: method: > May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: exception: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.281503 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: action_args: {'id': '62ecf924-4cfd-40a6-8d24-66b488062838'} May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:46.282867 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. May 13 14:07:46.284481 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: ERROR nova.api.openstack.wsgi May 13 14:07:46.285940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] Returning 404 to user: Instance 62ecf924-4cfd-40a6-8d24-66b488062838 could not be found. {{(pid=123954) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:46.285940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-6b2b8193-ce70-4f4a-a36f-c3ba3161b0fa tempest-AttachVolumeNegativeTest-1923347245 tempest-AttachVolumeNegativeTest-1923347245-project] 10.222.0.24 "GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838" status: 404 len: 111 microversion: 2.1 time: 0.030188 May 13 14:07:46.285940 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 707/1428] 10.222.0.24 () {58 vars in 1235 bytes} [Fri May 13 14:07:46 2022] GET /compute/v2.1/servers/62ecf924-4cfd-40a6-8d24-66b488062838 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:50.648119 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-0dbb98ab-afdb-4014-ad1e-d084a595636d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Action: 'create', calling method: .version_select at 0x7ff159101c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1168816059", "metadata": {"Type": "work"}}} {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:50.952432 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-0dbb98ab-afdb-4014-ad1e-d084a595636d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.437466 May 13 14:07:50.953310 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 722/1429] 10.222.0.24 () {60 vars in 1155 bytes} [Fri May 13 14:07:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 14:07:50.964876 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-d5f69816-295f-45da-824d-9e1578217ee0 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff1542ca3a0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:51.023561 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-d5f69816-295f-45da-824d-9e1578217ee0 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 200 len: 353 microversion: 2.1 time: 0.063128 May 13 14:07:51.024435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 708/1430] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:07:50 2022] GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:52.042458 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-61fe998f-d178-404c-86a2-d83ffc6e1c71 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff15408d160>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:52.097114 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-61fe998f-d178-404c-86a2-d83ffc6e1c71 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 200 len: 354 microversion: 2.1 time: 0.061571 May 13 14:07:52.097896 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 723/1431] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:07:52 2022] GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:52.112296 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-cd700341-5228-406e-a077-1b0a426790a8 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff1541a0940>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:52.166003 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-cd700341-5228-406e-a077-1b0a426790a8 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 200 len: 354 microversion: 2.1 time: 0.058051 May 13 14:07:52.166626 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 709/1432] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:07:52 2022] GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:52.191148 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-630cdbb2-3bca-4e72-a5c8-eec72d0b07d8 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff15913b0d0>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:52.263470 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-630cdbb2-3bca-4e72-a5c8-eec72d0b07d8 tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 202 len: 0 microversion: 2.1 time: 0.078472 May 13 14:07:52.264074 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 724/1433] 10.222.0.24 () {58 vars in 1247 bytes} [Fri May 13 14:07:52 2022] DELETE /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:07:52.272352 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: DEBUG nova.api.openstack.wsgi [None req-92c8b248-0ffc-49fa-9dfa-c41f11490a7c tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff1555a25e0>' {{(pid=123954) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:52.318924 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO nova.api.openstack.requestlog [None req-92c8b248-0ffc-49fa-9dfa-c41f11490a7c tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 200 len: 353 microversion: 2.1 time: 0.050534 May 13 14:07:52.319488 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: [pid: 123954|app: 0|req: 710/1434] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:07:52 2022] GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:53.336017 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca866c29-c508-45f9-acfb-e23bde68568d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Calling method '.version_select at 0x7ff159167f70>' {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:53.372117 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.wsgi [None req-ca866c29-c508-45f9-acfb-e23bde68568d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] HTTP exception thrown: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca866c29-c508-45f9-acfb-e23bde68568d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Request method failure captured: May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: request: GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 HTTP/1.1 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept: application/json May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Accept-Encoding: identity May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Connection: close May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Length: 0 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Content-Type: application/json May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Host: 10.222.0.24 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Openstack-System-Scope: None May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: User-Agent: python-urllib3/1.26.9 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Auth-Token: gAAAAABifmY2X7Zpx85vO_PsOdoE4N5fra8uEQx0OdRMn3Z1u8wBibPb6ezPE6a2ml7MNspYaxtkwM_5cRbVJnvJFTz4K2q9Cc0T54_rDZRbWINHwa7o98vtABZgfrB5ANDydVVc6vlb1QkwCvVHGst01bYT01pcm6_FKKnleIPzptXzxhsQsKc May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Id: None May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Domain-Name: None May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Identity-Status: Confirmed May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Is-Admin-Project: True May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Id: default May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Domain-Name: Default May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Id: dde5c8fa56fc4af693ee114509524d83 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Project-Name: tempest-VolumesGetTestJSON-669946947 May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Role: member,reader May 13 14:07:53.374548 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Roles: member,reader May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dde5c8fa56fc4af693ee114509524d83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/dde5c8fa56fc4af693ee114509524d83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_dde5c8fa56fc4af693ee114509524d83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/dde5c8fa56fc4af693ee114509524d83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant: tempest-VolumesGetTestJSON-669946947 May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Id: dde5c8fa56fc4af693ee114509524d83 May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-Tenant-Name: tempest-VolumesGetTestJSON-669946947 May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User: tempest-VolumesGetTestJSON-669946947-project May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Id: default May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Domain-Name: Default May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Id: b2df287f0d4442a1963cacbdc0b54d7a May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: X-User-Name: tempest-VolumesGetTestJSON-669946947-project May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: method: May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: exception: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: action_args: {'id': '72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0'} May 13 14:07:53.376159 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: {{(pid=123955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. (HTTP 404) (Request-ID: req-9381923b-af04-46e7-aac3-68d871aecf3f) May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:53.377108 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:07:53.378686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:07:53.380314 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: ERROR nova.api.openstack.wsgi May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: DEBUG nova.api.openstack.wsgi [None req-ca866c29-c508-45f9-acfb-e23bde68568d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] Returning 404 to user: Volume 72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 could not be found. {{(pid=123955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO nova.api.openstack.requestlog [None req-ca866c29-c508-45f9-acfb-e23bde68568d tempest-VolumesGetTestJSON-669946947 tempest-VolumesGetTestJSON-669946947-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0" status: 404 len: 109 microversion: 2.1 time: 0.047175 May 13 14:07:53.381779 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: [pid: 123955|app: 0|req: 725/1435] 10.222.0.24 () {58 vars in 1244 bytes} [Fri May 13 14:07:53 2022] GET /compute/v2.1/os-volumes/72c2f11b-b2c8-4b99-8fb3-ff056a1ef3b0 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:09:16.226871 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:09:16.227660 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 14:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:09:16.732441 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:09:16.732624 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 14:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:09:47.132527 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:09:47.133137 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:09:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:11:01.474339 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:11:01.475341 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:11:11.216164 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:11:11.216830 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:36.238735 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:36.239688 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 14:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:36.743496 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:36.743686 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 14:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:57.715616 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:57.716749 dv-cinder-795785-8-iscsi devstack@n-api.service[123955]: Fri May 13 14:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:13:07.144363 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:13:07.145458 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:13:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:14:21.488435 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:14:21.489575 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:14:31.225428 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:14:31.226612 dv-cinder-795785-8-iscsi devstack@n-api.service[123954]: Fri May 13 14:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!